Questions tagged [neural-networks]
Questions involving defining, training, executing, importing and exporting neural networks.
426
questions
2
votes
1answer
20 views
How to change Input Port dimensions in NetChain containing NetMapOperator
Today I tried to build a fully convolutional 3D DeconvolutionLayer. However I encountered a peculiar problem.
Lets define the 3D layer as:
...
3
votes
0answers
35 views
Transforming a checkerboard using Transpose and ReshapeLayers
In the paper for RealNVP, they introduce a "squeezing" operation that takes a matrix and transforms it to have more channels, according to the following transformation (before and after):
As you can ...
1
vote
0answers
25 views
Loss layer for vectors with component mixing or non-trainable number array in NN layer
Suppose we need to construct an unconventional loss function for my neural network: vector MSE but taking into account the "similarity" of variables.
My network takes data vectors ($m=40$ D) and ...
5
votes
1answer
106 views
How to simplify this NetGraph a bit?
I have a NetGraph that takes list of sublists, and outputs a real value that is higher when there are more near duplicate sublists.
For example, run this code ...
1
vote
1answer
42 views
How to train a deep NLP model for text generation?
I'm looking for an example of finetuning or (training from scratch) either GPT-2 or ctrl with NetTrain to generate text. Given a title, topic, url or other control ...
9
votes
1answer
125 views
How to implement BlazeFace?
BlazeFace is a lightweight and well-performing face detector tailored for mobile GPU inference. It runs at a speed of 200-1000+ FPS on flagship devices. How to implement BlazeFace in Mathematica?
9
votes
2answers
238 views
Can I use Mathematica to generate candle scents?
I found this blog (which is highly entertaining). It has an interesting post where the author uses the GPT-2 neuro-network with candle scent training data to generate new candle scents. The AI comes ...
4
votes
0answers
75 views
Neural network for a simple game?
I'm taking a class that is based on the Mathematica coding language, and we must do a 6-week final project. I am considering coding a neural network for a simple game like 2048, pacman, snake, etc. ...
6
votes
1answer
215 views
Getting cell edges from a picture
I would like to write a program that, given a picture of an epithelium (2D cell array), for example
automatically detects the cell edges and returns the corresponding lattice. Illustratively,
...
4
votes
1answer
61 views
Adding Noise in Neural Net via ElementwiseLayer
I am trying to add noise to a neural net to train a denoising autoencoder. I don't want to pre-calculate the noisy data. Rather, I'd like the noise be applied via a function using the ElementwiseLayer....
1
vote
0answers
19 views
Training with GPU and tuning parameters with ParallelTable
We intend to train a neural network. It has a hyperparameter, such as the learning rate. We want to compare the training results of different hyperparameters. Our computer has two multi-core CPUs and ...
2
votes
0answers
41 views
Fuzzy Logic and Neural Networks
Is anyone working on building a Fuzzy Logic module that can be used for the output of Neural Networks?
Thank You
Michel
5
votes
0answers
132 views
How can I prevent errors with ReplicateLayer[]?
I am trying to build a NetGraph[] that takes input of the form {{0.6},{0.6},...,{0.8},{0.8}} and multiplies the last sequence ...
1
vote
0answers
74 views
is the code of this reinforcement learning example correct?
I am trying to learn reinforcement learning from an article on Wolfram.com, and after several days I still cannot quite get everything right. Now I wonder about the correctness of a piece of code ...
2
votes
1answer
58 views
How can I use ThreadingLayer to perform operations with layers of different dimmensions?
Is there a way that I can achieve subtraction between a scalar and a vector within NetGraph[], similar to what happens when I perform ...
1
vote
0answers
31 views
NetTrain with Quadro
I have an Nvidia Quadro P620/PCIe/SSE2 graphics card on my linux box (Ubuntu 18.04):
<<CUDALink`
CUDAQ[] (*True*)
CUDADriverVersion[] (* 390.116.0 *)
But ...
0
votes
1answer
96 views
Does lower case n have some significance in the Wolfram Language? [duplicate]
I am truly confused with this one, and maybe someone could help me to clear this up.
I am running a Table[] that runs multiple neural networks in series on OpenAI'...
3
votes
1answer
59 views
Controlling learning rate decay or cyclic learning rate in Mathematica's neural nets
I am using Mathematica's NetTrain[] function for training neural nets. There is a way to set the learning rate (LearningRate and ...
14
votes
3answers
371 views
Importing a grid of numbers from an image (sudoku like)
Can anyone see a way to import a grid of numbers from
http://www.mit.edu/~puzzle/2019/puzzle/lantern_festival.html
into Mathematica? TextRecognize doesn't seem ...
2
votes
1answer
101 views
Rounding the output Vector of a Neural Network layer to prepare it for the next layer
I am attempting to Round up the output Vector of a Neural Network layer to prepare it for the next layer
Ex. Layer output {.1.,2.2,3.3} and I need it to be a Vector of Integers for the next layer.
I ...
0
votes
0answers
67 views
How to make my custom neural layer only apply noise during training (similar to how DropoutLayer behaves)?
Utilizing some undocumented Mathematica functionality, I implemented it like this:
...
4
votes
0answers
185 views
Image-based reinforcement learning with neural networks
After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
0
votes
0answers
20 views
BatchNormalizationLayer instead of data prep
I've trained a neural net to match nx7x5 matrices to nx1 scalars; the n is a number of elements in a sequence. To get a good match I have to do some data prep; basically do a ...
6
votes
0answers
152 views
Manually converting TensorFlow models to Mathematica
Is
Mathematica (v12, my third, semi-informed, attempt at manual conversion)
...
1
vote
0answers
60 views
0
votes
0answers
31 views
NetDecoder using InverseShortTimeFourier, InverseSpectrogram, or Audio, etc., Possible?
I'm finding it impossible to create a NetDecoder to function as the inverse equivalent of, e.g., NetEncoder["AudioSTFT"], ...
0
votes
1answer
83 views
Transform function {a,b} ->{x,y} ; how to?
I have a 2D list of values that I want to transform/calibrate to another 2D list. I thought of using a predict function but I couldn’t get it to output 2 values.
—...
1
vote
0answers
84 views
Measuring Degree Correlations of Networks
I'm trying to write a program that will measure the degree correlation of the network. The theory is here (page 8).
I've written something like this up to now:
...
0
votes
0answers
60 views
Distance matrix inside a neural net
So what I would like to do is to create a NetGraph that takes in an $n\times 3$ (with $n$ varying in length) list of 3D coordinates as an input and creates an $n \times n$ distance matrix or an $\frac{...
2
votes
0answers
73 views
How to train custom objects using YOLO in Mathematica?
I want to train few custom object using YOLO V2 architecture but not sure how to do this. I know that with the NetTake and NetReplace, this is achievable. Can someone point out me in the right ...
2
votes
0answers
62 views
Deep neural network training on large datasets
I am training a deep net on large training dataset. I read the tutorial from the following link:
Training on Large Datasets.
I have put each predictor-preditand tuple into a separate mx file.
My ...
0
votes
1answer
61 views
Classifying numeric vector data [closed]
Neural Networks seem so complex these days.
Can anyone please suggest a simple structure (i.e. code) for training numeric vector data: examples of 24 numeric inputs to produce 1 (integer) numeric ...
0
votes
0answers
14 views
Best approach to Save the BestValidationRound throughout training
I have a network that I would like to train.I would like at the end of training to be able to have the BestValidationRound, from all training Rounds.
I would not want to have ...
3
votes
3answers
89 views
Unable to attach a new NetDecoder to a NetModel following the documentation
I am following the documentation in the page https://reference.wolfram.com/language/ref/NetModel.html.
I am getting error when I try to execute the code given for attaching NetDecoder for a given ...
3
votes
0answers
55 views
Net layer that replicates last element
I am trying to design a neural network layer that takes in an array of dimensions n x 100, and produces an array of dimensions ...
3
votes
0answers
25 views
Output of TransposeLayer[] is not fully specified, but why?
So I created and initialized the following NetGraph:
...
0
votes
1answer
54 views
Image matching and transformation
I hope this picture can help me to be clearer.
The triangles represent some values of an image (EDITED: positions).
The same for the circles, but from a different image.
Some values matches, some ...
4
votes
0answers
28 views
Change the FullSummaryGraphic size for deep neural networks
I am using the "FullSummaryGraphics" of a neural network:
NetInformation[model,"FullSummaryGraphic"]
After having the following result:
I would like to modify ...
0
votes
1answer
99 views
Using a neural net to make predictions
I want to use a neural net to give predictions, but I am not sure where to start. I do know that I don't want to use the high-level Predict function.
So what I ...
4
votes
1answer
131 views
Neural net with scalar Boolean output for binary classification
How can I create and train a neural network with a scalar Boolean output for binary classification, and hopefully have it automatically compute the "ErrorRate" ...
3
votes
0answers
60 views
NetGraph copying by reference
I have a GAN defined like so:
GAN = NetGraph[{"gen" -> generator,
"dis" -> discriminator}, {"gen" -> "dis"}];
My question is if I use NetTrain on ...
3
votes
1answer
103 views
NetTrain does not update the parameters of NetSharedArray
I am attempting to use a Neural Network to solve differential equations based on a method I read in a paper. This involves constructing multiple separate NetGraph ...
2
votes
1answer
56 views
Output of the trained neural network for a set of inputs
Sorry if this was too trivial but I want to get the output of the neural network I trained for the specific inputs that I feed. The notation I often saw was of TrainedNet[inp] kind. But when I use ...
0
votes
0answers
116 views
Error Histogram of a Neural Network
Can you plot the error histogram of a trained network (with test, train and validation sets if possible but one would be enough)?
Matlab Easily does that for you but I could not find a function that ...
0
votes
0answers
28 views
Transfer learning with different input size
How to do transfer learning for the input of dimension (64x64x1)using Resnet-50, which has three-channel input (224x224x3)?
11
votes
2answers
240 views
Custom SGD optimizer in Mathematica neural network framework?
I have a new approach to SGD optimizer, and thought to try to test it in Mathematica. It uses gradients to simultaneously maintain online parabola model for smarter choice of step size - I only need ...
2
votes
1answer
59 views
Chaining NetGraphs
I have two NetGraphs, each with 3 different input ports ("Input","Random1","Random2"), the first with 2 outputs ("Output" and "Loss") and the second with one output "Final_Out". All I want to do is "...
2
votes
0answers
220 views
How to generate names with a GAN?
I'd like a tutorial for text generation using GANs, specifically for names. I have a list of company names and would like the network to generate novel ones.
This is one of the only few examples of ...
0
votes
0answers
46 views
No progress on validation NN training set
So in short my issue is that I'am training a neural network and while the training loss reduces over time, the loss of validation set remains constant.
The progress of training looks like this:
I am ...
3
votes
2answers
249 views
Does Mathematica 12 support GT 730 CUDA?
I am getting the following error when I set the target device as GPU:
NetTrain::trgdevegpu: TargetDevice -> GPU could not be used; a
supported NVIDIA GPU was not found. If you are using an ...
