Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
2
votes
0answers
30 views

Fuzzy Logic and Neural Networks

Is anyone working on building a Fuzzy Logic module that can be used for the output of Neural Networks? Thank You Michel
4
votes
0answers
65 views
+50

How can I prevent errors with ReplicateLayer[]?

I am trying to build a NetGraph[] that takes input of the form {{0.6},{0.6},...,{0.8},{0.8}} and multiplies the last sequence ...
1
vote
0answers
58 views

is the code of this reinforcement learning example correct?

I am trying to learn reinforcement learning from an article on Wolfram.com, and after several days I still cannot quite get everything right. Now I wonder about the correctness of a piece of code ...
2
votes
1answer
50 views

How can I use ThreadingLayer to perform operations with layers of different dimmensions?

Is there a way that I can achieve subtraction between a scalar and a vector within NetGraph[], similar to what happens when I perform ...
1
vote
0answers
28 views

NetTrain with Quadro

I have an Nvidia Quadro P620/PCIe/SSE2 graphics card on my linux box (Ubuntu 18.04): <<CUDALink` CUDAQ[] (*True*) CUDADriverVersion[] (* 390.116.0 *) But ...
0
votes
1answer
93 views

Does lower case n have some significance in the Wolfram Language? [duplicate]

I am truly confused with this one, and maybe someone could help me to clear this up. I am running a Table[] that runs multiple neural networks in series on OpenAI'...
3
votes
1answer
36 views

Controlling learning rate decay or cyclic learning rate in Mathematica's neural nets

I am using Mathematica's NetTrain[] function for training neural nets. There is a way to set the learning rate (LearningRate and ...
14
votes
3answers
328 views

Importing a grid of numbers from an image (sudoku like)

Can anyone see a way to import a grid of numbers from http://www.mit.edu/~puzzle/2019/puzzle/lantern_festival.html into Mathematica? TextRecognize doesn't seem ...
2
votes
1answer
89 views

Rounding the output Vector of a Neural Network layer to prepare it for the next layer

I am attempting to Round up the output Vector of a Neural Network layer to prepare it for the next layer Ex. Layer output {.1.,2.2,3.3} and I need it to be a Vector of Integers for the next layer. I ...
0
votes
0answers
61 views

How to make my custom neural layer only apply noise during training (similar to how DropoutLayer behaves)?

Utilizing some undocumented Mathematica functionality, I implemented it like this: ...
4
votes
0answers
176 views

Image-based reinforcement learning with neural networks

After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
0
votes
0answers
18 views

BatchNormalizationLayer instead of data prep

I've trained a neural net to match nx7x5 matrices to nx1 scalars; the n is a number of elements in a sequence. To get a good match I have to do some data prep; basically do a ...
6
votes
0answers
149 views

Manually converting TensorFlow models to Mathematica

Is Mathematica (v12, my third, semi-informed, attempt at manual conversion) ...
1
vote
0answers
59 views

Re-train a neural network discarding its memory?

...
0
votes
0answers
26 views

NetDecoder using InverseShortTimeFourier, InverseSpectrogram, or Audio, etc., Possible?

I'm finding it impossible to create a NetDecoder to function as the inverse equivalent of, e.g., NetEncoder["AudioSTFT"], ...
0
votes
1answer
80 views

Transform function {a,b} ->{x,y} ; how to?

I have a 2D list of values that I want to transform/calibrate to another 2D list. I thought of using a predict function but I couldn’t get it to output 2 values. —...
1
vote
0answers
83 views

Measuring Degree Correlations of Networks

I'm trying to write a program that will measure the degree correlation of the network. The theory is here (page 8). I've written something like this up to now: ...
0
votes
0answers
53 views

Distance matrix inside a neural net

So what I would like to do is to create a NetGraph that takes in an $n\times 3$ (with $n$ varying in length) list of 3D coordinates as an input and creates an $n \times n$ distance matrix or an $\frac{...
2
votes
0answers
64 views

How to train custom objects using YOLO in Mathematica?

I want to train few custom object using YOLO V2 architecture but not sure how to do this. I know that with the NetTake and NetReplace, this is achievable. Can someone point out me in the right ...
2
votes
0answers
59 views

Deep neural network training on large datasets

I am training a deep net on large training dataset. I read the tutorial from the following link: Training on Large Datasets. I have put each predictor-preditand tuple into a separate mx file. My ...
0
votes
1answer
55 views

Classifying numeric vector data [closed]

Neural Networks seem so complex these days. Can anyone please suggest a simple structure (i.e. code) for training numeric vector data: examples of 24 numeric inputs to produce 1 (integer) numeric ...
0
votes
0answers
14 views

Best approach to Save the BestValidationRound throughout training

I have a network that I would like to train.I would like at the end of training to be able to have the BestValidationRound, from all training Rounds. I would not want to have ...
3
votes
3answers
79 views

Unable to attach a new NetDecoder to a NetModel following the documentation

I am following the documentation in the page https://reference.wolfram.com/language/ref/NetModel.html. I am getting error when I try to execute the code given for attaching NetDecoder for a given ...
3
votes
0answers
54 views

Net layer that replicates last element

I am trying to design a neural network layer that takes in an array of dimensions n x 100, and produces an array of dimensions ...
3
votes
0answers
22 views

Output of TransposeLayer[] is not fully specified, but why?

So I created and initialized the following NetGraph: ...
0
votes
1answer
53 views

Image matching and transformation

I hope this picture can help me to be clearer. The triangles represent some values of an image (EDITED: positions). The same for the circles, but from a different image. Some values matches, some ...
4
votes
0answers
28 views

Change the FullSummaryGraphic size for deep neural networks

I am using the "FullSummaryGraphics" of a neural network: NetInformation[model,"FullSummaryGraphic"] After having the following result: I would like to modify ...
0
votes
1answer
88 views

Using a neural net to make predictions

I want to use a neural net to give predictions, but I am not sure where to start. I do know that I don't want to use the high-level Predict function. So what I ...
4
votes
1answer
118 views

Neural net with scalar Boolean output for binary classification

How can I create and train a neural network with a scalar Boolean output for binary classification, and hopefully have it automatically compute the "ErrorRate" ...
3
votes
0answers
56 views

NetGraph copying by reference

I have a GAN defined like so: GAN = NetGraph[{"gen" -> generator, "dis" -> discriminator}, {"gen" -> "dis"}]; My question is if I use NetTrain on ...
3
votes
1answer
92 views

NetTrain does not update the parameters of NetSharedArray

I am attempting to use a Neural Network to solve differential equations based on a method I read in a paper. This involves constructing multiple separate NetGraph ...
1
vote
1answer
49 views

Output of the trained neural network for a set of inputs

Sorry if this was too trivial but I want to get the output of the neural network I trained for the specific inputs that I feed. The notation I often saw was of TrainedNet[inp] kind. But when I use ...
0
votes
0answers
88 views

Error Histogram of a Neural Network

Can you plot the error histogram of a trained network (with test, train and validation sets if possible but one would be enough)? Matlab Easily does that for you but I could not find a function that ...
0
votes
0answers
26 views

Transfer learning with different input size

How to do transfer learning for the input of dimension (64x64x1)using Resnet-50, which has three-channel input (224x224x3)?
11
votes
2answers
210 views

Custom SGD optimizer in Mathematica neural network framework?

I have a new approach to SGD optimizer, and thought to try to test it in Mathematica. It uses gradients to simultaneously maintain online parabola model for smarter choice of step size - I only need ...
2
votes
1answer
56 views

Chaining NetGraphs

I have two NetGraphs, each with 3 different input ports ("Input","Random1","Random2"), the first with 2 outputs ("Output" and "Loss") and the second with one output "Final_Out". All I want to do is "...
2
votes
0answers
149 views

How to generate names with a GAN?

I'd like a tutorial for text generation using GANs, specifically for names. I have a list of company names and would like the network to generate novel ones. This is one of the only few examples of ...
0
votes
0answers
39 views

No progress on validation NN training set

So in short my issue is that I'am training a neural network and while the training loss reduces over time, the loss of validation set remains constant. The progress of training looks like this: I am ...
3
votes
2answers
233 views

Does Mathematica 12 support GT 730 CUDA?

I am getting the following error when I set the target device as GPU: NetTrain::trgdevegpu: TargetDevice -> GPU could not be used; a supported NVIDIA GPU was not found. If you are using an ...
5
votes
0answers
96 views

Gradient of neural network output with respect to input

Context: I'm studying adversarial attacks on neural networks. These attacks are grouped into targeted, where a legitimate input is changed by some imperceptible amount and the new input is miss-...
6
votes
0answers
73 views

How can one train a Neural Network in Mathematica such as to recognise and count all occurrences of a certain custom category in an image?

I'm trying to use Mathematica for the following task: (1) Get an aereal view of a certain area in Mongolia (2) Count the number of plots that contain houses, and the number of plots that contain ...
5
votes
1answer
103 views

Error during training neural network: input is not an integer between 1 and 100 although it is

I imported my data from Matlab in matrix form and tried to use it in a neural network as given below but I get the error that says the input is not an integer between 1 and 100 although it is. <...
7
votes
0answers
72 views

Possible NetTrain[] memory leak when training in GPU

I've just moved to Mathematica 12.0 (from 11.3) and sometimes NetTrain[] will fail with the following error: ...
5
votes
1answer
292 views

How do I create & train a neural net to predict a stock closing price at T+5min using OHLC and other data?

I'm trying to create a neural network and train it to test predictability of short term stock price movements. I've collated a 1-min open, high, low, closing and volume dataset for a particular stock....
2
votes
0answers
98 views

Hessian of a loss function for a neural netwrok

Is a way to calculate the Hessian of the loss function in Mathematica. It's easy to define a loss function for neural nets but I couldn't figure out how to calculate the Hessian(more precisely I ...
1
vote
0answers
60 views

Loss function for an unsupervised neural network

I am trying to use a neural network approach to fit a model based on two sets of data: the "before" set and the "after" set. The "after" set is the subset of "before" examples that have survived to a ...
0
votes
0answers
49 views

Can we train a same network two times with Mathematica?

I have a simple question about Mathematica 11.3. Is is possible to train a model of neural network with NetTrain in several steps like with Keras? Perhaps do I have to (1) create my model, (2) train ...
0
votes
0answers
38 views

Splitting large matrix in neural network

I'm trying to make a neural network that takes a 16x100x100 matrix and splits it into each 100x100 part, puts each through a dense layer, and then puts them them together once again to form a 16x10x10 ...
7
votes
1answer
137 views

NetTrain Freezes Computer

I have a neural network I am trying to train: ...
6
votes
0answers
144 views

Export ImageCases to Python?

I’d like a tutorial on how to export a bounding box detector network to mxnet, (for bonus points: convert to Tensorflow), and then get it running correctly in python! Some related questions exist for ...