Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
2
votes
1answer
20 views

How to change Input Port dimensions in NetChain containing NetMapOperator

Today I tried to build a fully convolutional 3D DeconvolutionLayer. However I encountered a peculiar problem. Lets define the 3D layer as: ...
3
votes
0answers
35 views

Transforming a checkerboard using Transpose and ReshapeLayers

In the paper for RealNVP, they introduce a "squeezing" operation that takes a matrix and transforms it to have more channels, according to the following transformation (before and after): As you can ...
1
vote
0answers
25 views

Loss layer for vectors with component mixing or non-trainable number array in NN layer

Suppose we need to construct an unconventional loss function for my neural network: vector MSE but taking into account the "similarity" of variables. My network takes data vectors ($m=40$ D) and ...
5
votes
1answer
106 views

How to simplify this NetGraph a bit?

I have a NetGraph that takes list of sublists, and outputs a real value that is higher when there are more near duplicate sublists. For example, run this code ...
1
vote
1answer
42 views

How to train a deep NLP model for text generation?

I'm looking for an example of finetuning or (training from scratch) either GPT-2 or ctrl with NetTrain to generate text. Given a title, topic, url or other control ...
9
votes
1answer
125 views

How to implement BlazeFace?

BlazeFace is a lightweight and well-performing face detector tailored for mobile GPU inference. It runs at a speed of 200-1000+ FPS on flagship devices. How to implement BlazeFace in Mathematica?
9
votes
2answers
238 views

Can I use Mathematica to generate candle scents?

I found this blog (which is highly entertaining). It has an interesting post where the author uses the GPT-2 neuro-network with candle scent training data to generate new candle scents. The AI comes ...
4
votes
0answers
75 views

Neural network for a simple game?

I'm taking a class that is based on the Mathematica coding language, and we must do a 6-week final project. I am considering coding a neural network for a simple game like 2048, pacman, snake, etc. ...
6
votes
1answer
215 views

Getting cell edges from a picture

I would like to write a program that, given a picture of an epithelium (2D cell array), for example automatically detects the cell edges and returns the corresponding lattice. Illustratively, ...
4
votes
1answer
61 views

Adding Noise in Neural Net via ElementwiseLayer

I am trying to add noise to a neural net to train a denoising autoencoder. I don't want to pre-calculate the noisy data. Rather, I'd like the noise be applied via a function using the ElementwiseLayer....
1
vote
0answers
19 views

Training with GPU and tuning parameters with ParallelTable

We intend to train a neural network. It has a hyperparameter, such as the learning rate. We want to compare the training results of different hyperparameters. Our computer has two multi-core CPUs and ...
2
votes
0answers
41 views

Fuzzy Logic and Neural Networks

Is anyone working on building a Fuzzy Logic module that can be used for the output of Neural Networks? Thank You Michel
5
votes
0answers
132 views

How can I prevent errors with ReplicateLayer[]?

I am trying to build a NetGraph[] that takes input of the form {{0.6},{0.6},...,{0.8},{0.8}} and multiplies the last sequence ...
1
vote
0answers
74 views

is the code of this reinforcement learning example correct?

I am trying to learn reinforcement learning from an article on Wolfram.com, and after several days I still cannot quite get everything right. Now I wonder about the correctness of a piece of code ...
2
votes
1answer
58 views

How can I use ThreadingLayer to perform operations with layers of different dimmensions?

Is there a way that I can achieve subtraction between a scalar and a vector within NetGraph[], similar to what happens when I perform ...
1
vote
0answers
31 views

NetTrain with Quadro

I have an Nvidia Quadro P620/PCIe/SSE2 graphics card on my linux box (Ubuntu 18.04): <<CUDALink` CUDAQ[] (*True*) CUDADriverVersion[] (* 390.116.0 *) But ...
0
votes
1answer
96 views

Does lower case n have some significance in the Wolfram Language? [duplicate]

I am truly confused with this one, and maybe someone could help me to clear this up. I am running a Table[] that runs multiple neural networks in series on OpenAI'...
3
votes
1answer
59 views

Controlling learning rate decay or cyclic learning rate in Mathematica's neural nets

I am using Mathematica's NetTrain[] function for training neural nets. There is a way to set the learning rate (LearningRate and ...
14
votes
3answers
371 views

Importing a grid of numbers from an image (sudoku like)

Can anyone see a way to import a grid of numbers from http://www.mit.edu/~puzzle/2019/puzzle/lantern_festival.html into Mathematica? TextRecognize doesn't seem ...
2
votes
1answer
101 views

Rounding the output Vector of a Neural Network layer to prepare it for the next layer

I am attempting to Round up the output Vector of a Neural Network layer to prepare it for the next layer Ex. Layer output {.1.,2.2,3.3} and I need it to be a Vector of Integers for the next layer. I ...
0
votes
0answers
67 views

How to make my custom neural layer only apply noise during training (similar to how DropoutLayer behaves)?

Utilizing some undocumented Mathematica functionality, I implemented it like this: ...
4
votes
0answers
185 views

Image-based reinforcement learning with neural networks

After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
0
votes
0answers
20 views

BatchNormalizationLayer instead of data prep

I've trained a neural net to match nx7x5 matrices to nx1 scalars; the n is a number of elements in a sequence. To get a good match I have to do some data prep; basically do a ...
6
votes
0answers
152 views

Manually converting TensorFlow models to Mathematica

Is Mathematica (v12, my third, semi-informed, attempt at manual conversion) ...
1
vote
0answers
60 views

Re-train a neural network discarding its memory?

...
0
votes
0answers
31 views

NetDecoder using InverseShortTimeFourier, InverseSpectrogram, or Audio, etc., Possible?

I'm finding it impossible to create a NetDecoder to function as the inverse equivalent of, e.g., NetEncoder["AudioSTFT"], ...
0
votes
1answer
83 views

Transform function {a,b} ->{x,y} ; how to?

I have a 2D list of values that I want to transform/calibrate to another 2D list. I thought of using a predict function but I couldn’t get it to output 2 values. —...
1
vote
0answers
84 views

Measuring Degree Correlations of Networks

I'm trying to write a program that will measure the degree correlation of the network. The theory is here (page 8). I've written something like this up to now: ...
0
votes
0answers
60 views

Distance matrix inside a neural net

So what I would like to do is to create a NetGraph that takes in an $n\times 3$ (with $n$ varying in length) list of 3D coordinates as an input and creates an $n \times n$ distance matrix or an $\frac{...
2
votes
0answers
73 views

How to train custom objects using YOLO in Mathematica?

I want to train few custom object using YOLO V2 architecture but not sure how to do this. I know that with the NetTake and NetReplace, this is achievable. Can someone point out me in the right ...
2
votes
0answers
62 views

Deep neural network training on large datasets

I am training a deep net on large training dataset. I read the tutorial from the following link: Training on Large Datasets. I have put each predictor-preditand tuple into a separate mx file. My ...
0
votes
1answer
61 views

Classifying numeric vector data [closed]

Neural Networks seem so complex these days. Can anyone please suggest a simple structure (i.e. code) for training numeric vector data: examples of 24 numeric inputs to produce 1 (integer) numeric ...
0
votes
0answers
14 views

Best approach to Save the BestValidationRound throughout training

I have a network that I would like to train.I would like at the end of training to be able to have the BestValidationRound, from all training Rounds. I would not want to have ...
3
votes
3answers
89 views

Unable to attach a new NetDecoder to a NetModel following the documentation

I am following the documentation in the page https://reference.wolfram.com/language/ref/NetModel.html. I am getting error when I try to execute the code given for attaching NetDecoder for a given ...
3
votes
0answers
55 views

Net layer that replicates last element

I am trying to design a neural network layer that takes in an array of dimensions n x 100, and produces an array of dimensions ...
3
votes
0answers
25 views

Output of TransposeLayer[] is not fully specified, but why?

So I created and initialized the following NetGraph: ...
0
votes
1answer
54 views

Image matching and transformation

I hope this picture can help me to be clearer. The triangles represent some values of an image (EDITED: positions). The same for the circles, but from a different image. Some values matches, some ...
4
votes
0answers
28 views

Change the FullSummaryGraphic size for deep neural networks

I am using the "FullSummaryGraphics" of a neural network: NetInformation[model,"FullSummaryGraphic"] After having the following result: I would like to modify ...
0
votes
1answer
99 views

Using a neural net to make predictions

I want to use a neural net to give predictions, but I am not sure where to start. I do know that I don't want to use the high-level Predict function. So what I ...
4
votes
1answer
131 views

Neural net with scalar Boolean output for binary classification

How can I create and train a neural network with a scalar Boolean output for binary classification, and hopefully have it automatically compute the "ErrorRate" ...
3
votes
0answers
60 views

NetGraph copying by reference

I have a GAN defined like so: GAN = NetGraph[{"gen" -> generator, "dis" -> discriminator}, {"gen" -> "dis"}]; My question is if I use NetTrain on ...
3
votes
1answer
103 views

NetTrain does not update the parameters of NetSharedArray

I am attempting to use a Neural Network to solve differential equations based on a method I read in a paper. This involves constructing multiple separate NetGraph ...
2
votes
1answer
56 views

Output of the trained neural network for a set of inputs

Sorry if this was too trivial but I want to get the output of the neural network I trained for the specific inputs that I feed. The notation I often saw was of TrainedNet[inp] kind. But when I use ...
0
votes
0answers
116 views

Error Histogram of a Neural Network

Can you plot the error histogram of a trained network (with test, train and validation sets if possible but one would be enough)? Matlab Easily does that for you but I could not find a function that ...
0
votes
0answers
28 views

Transfer learning with different input size

How to do transfer learning for the input of dimension (64x64x1)using Resnet-50, which has three-channel input (224x224x3)?
11
votes
2answers
240 views

Custom SGD optimizer in Mathematica neural network framework?

I have a new approach to SGD optimizer, and thought to try to test it in Mathematica. It uses gradients to simultaneously maintain online parabola model for smarter choice of step size - I only need ...
2
votes
1answer
59 views

Chaining NetGraphs

I have two NetGraphs, each with 3 different input ports ("Input","Random1","Random2"), the first with 2 outputs ("Output" and "Loss") and the second with one output "Final_Out". All I want to do is "...
2
votes
0answers
220 views

How to generate names with a GAN?

I'd like a tutorial for text generation using GANs, specifically for names. I have a list of company names and would like the network to generate novel ones. This is one of the only few examples of ...
0
votes
0answers
46 views

No progress on validation NN training set

So in short my issue is that I'am training a neural network and while the training loss reduces over time, the loss of validation set remains constant. The progress of training looks like this: I am ...
3
votes
2answers
249 views

Does Mathematica 12 support GT 730 CUDA?

I am getting the following error when I set the target device as GPU: NetTrain::trgdevegpu: TargetDevice -> GPU could not be used; a supported NVIDIA GPU was not found. If you are using an ...

1
2 3 4 5
9