# Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

533 questions
Filter by
Sorted by
Tagged with
95 views

### How to detect chains (sequence of degree 2 vertices ) in a graph?

I am interested in finding the positions of "chains" (sequences of vertex degree 2 vertices) in a graph. I plan on collapsing these chains later to vertices with labels indicating that they ...
62 views

### Applying Super-Resolution to differently sized images

I would like to make some images larger and noticed that there is a page in the documentation for doing super-resolution using a network structure. It's called "A Model for Super-Resolution."...
• 65.7k
1 vote
45 views

### Does RandomArrayLayer implement the reparameterization trick?

I want to backpropagate through random operations (e.g. learn the mean and variance of a Gaussian random variable). I assumed that ...
• 11
21 views

### Create "PredictorFunction" with NeuralNetwork

I tried to construct a predictor for a continuous variable using neural networks, something like f(a,b,c,d,e) = x, trying to predict x for a given set of a,b,c,d, and e. The builtin ...
• 21
25 views

### Reshaping Output of a NetGraph during training

I'm trying to train a (per-pixel) segmentation neural net using the undocumented HDF5 training facilities that are laid out in this question. Here is a slightly modified version of the answer to that ...
• 710
64 views

### How to make the output of NetTrain obey constraints?

Imagine I have this trained = NetTrain[LinearLayer[], {1 -> {0.1,0.7,0.2}, 2 -> {0,0,1}, 3 -> {0.4,0.4,0.2}, 4 -> {0.1,0.0,0.9}}] I want to ...
• 1,398
1 vote
36 views

### BasicRecurrentLayer with no bias and linear activation function?

Trying to design a small neural network for modeling a LTI system, I'd like to configure a BasicRecurrentLayer with these particular settings: No bias vector should be used (I've tried the option &...
• 123
114 views

### Unexpected high memory consumption using out-of-core NetTrain

I'm working on training a neural network on an image dataset. There are 14k images and each image contains 3x150x150 pixels. I have built a generator function following the approach in Training on ...
145 views

### Constructing neural networks from Keras example

I am trying to convert neural networks from a book to Wolfram language. The book has this example with the quote two layers of 10 neurons and a dropout of 0.2 for each ...
• 483
30 views

### Transfer Learning Model in two ways

I have tried a lot. But no method can't work. How to correct it? The link is the code below. Dataset Preparation -> blancedTrain, blancedTest ...
70 views

### CrossValidate for image classification with NetTrain

I am trying to set up transfer learning using instructions from this repository page on EfficientNet. I am able to perform a stand-alone training and testing using the instructions on that page. The ...
• 483
33 views

### Neural Nets: Can the back propagation/deep dream step be computed within the Net itself

I am trying see if I can do a deep dreaming algorithm without exiting a neural net. This Generalized Backpropagation for Neural Networks (e.g. DeepDream) has a nice discussion of using the ...
• 2,058
1 vote
81 views

### Is there a difference between ElementwiseLayer@Ramp and Ramp in NetGraph?

This is about neural net! I put what I want to ask in the picture! This is the code! ...
• 41
31 views

### Ranges of ANN predict values too narrow

I plan to train a neural network on a large dataset. Each example contain 16 parameters (inputs) and 1 output. A snapshot of the dataset looks like: net = ParallelTable[Parasets[[i]] -> {degraeffr[...
42 views

### How to manipulate neural network output data?

I have a large list data for neural network training in the form {x1 -> y1, … , xn -> yn} Where the outputs $y_i$ is either 1 or 0 and the inputs $x_i$ are ...
• 285
29 views

### EmbeddingLayer with variable input length is incompatible with LinearLayer?

EmbeddingLayer$size, n$ trains a representation of a list of integers between 1 and n into a real vector of dimension ...
• 2,360
194 views

### Exactly recreating image NetEncoder output

I need to run an exported NetChain in ONNX, surprisingly the model exports and runs successfully, but there's a discrepancy in the image loading stage (the NetEncoder'ing that must be written manually)...
• 3,720
43 views

### Spliting training dataset in ANN training using NetTrain

I am training a neural network on large training dataset containing 25,525,200 examples. each example contain 15 parameters (inputs) and 1 output, such as Inputs 0.015,83.6,0.663,0.104,0.097,0.167,0....
76 views

### Automated mapping between input and output columns of FeatureExtractorFunctions

This problem is about FeatureExtraction. It arose in the course of training a neural network where the data contains a mixture of nominal and numeric variables. Basically, my code looks like the ...
• 2,962
1 vote
29 views

### Repeated calculation with neural network measurement slows down

I have a list of 200 neural nets nets0. I have to measure the output of several layers of each of them on a list of 1000 associations ...
• 195
1 vote
88 views

### Increase the speed of Machine learning based on 'Predict'

I am training a ANN model with a large dataset (~million level) using Predict or NetTrain function. I do not have a GPU machine but have a server equipped with 16 CPU cores. How can I maximize the ...
1 vote
79 views

### Unknown Error in NetGraph with RTX 3090 GPU

I am running NetGraph on my RTX 3090 GPU. The Net itself loads properly in my GPU, having an approximate size of 9GB (the 3090 has 24GB of memory). However, once the net actually starts NetGraph ...
72 views

### How to calculate a PDF of a neural network output?

I have to find the probability density function of the output of an internal layer in a neural network. I wanted to do it using NetMeasurements adding a layer like <...
• 195
53 views

### NetNestOperator with custom input / output ports

I'd like to use NetNestOperator on a NetGraph that has custom input / output port names, such as ...
• 1,995
319 views

### Neural Network Automatic Differentiation ("Autograd")

Automatic differentiation methods in general have been the topic of past questions, but this is specifically about automatic differentiation of neural networks. The motivation is an old but useful ...
• 2,360
102 views

### Prevent overfitting in Predict function

I know that you can prevent overtraining automatically in a network if you use NetTrain with NetChain in Mathematica version 12, ...
• 489
398 views

### Wolfram Neural Net Repository Questions

I am a research scientist in the machine learning team, and mostly involved with the neural net repository. One of the discussions with my group raised these question in my mind, and these might be ...
1 vote
32 views

### Problems extracting a layer from a deep network

I am trying to reproduce this deep net for pose estimation. (v. 11.3, MacOS) I download the VGG network, as specified: ...
• 35.8k
60 views

### Mathematica accuracy errors when creating data

I created training data for a neural network and below are two errors I got The only code that uses "FindRoot" command is the following ...
• 285
47 views

### How to connect NetEncoder to LinearLayer

While using Encoder and LinearLayer separately ...
• 654
43 views

### Error Using NetMeasurements (assessing neural network performance)

I am trying to assess how well a neural network regression model performs on test data. To do this I have used NetMeasurements command. ...
• 285
1 vote
139 views

### Building multilayer perceptron Neural Network

I’m new to machine learning and am a bit confused about how to create a neural network (multilayer perceptron) with a specific design. I would like to create a neural network with 40 features/neurones ...
• 285
38 views

### Convolution layer input size error

I have network which I want to take in a $6 \times 2761$ 'image' and output into one of three classifications. I have 240 of these images that I would like to train with. My training list therefore ...
• 169
125 views

### Anyone has any succes on GPU NetTrain with RemoteBatchSubmit on AWS EC2?

Since 12.3, the RemoteBatchSubmit to EC2 does not work anymore. First, it features the same bug as Version 12.3.1 Problems with NetTrain, where the MXNetResources paclet is 12.4 instead of 12.3. ...
525 views

### Version 12.3.1 Problems with NetTrain

Until now I am using MMA 12.2 because NetTrain istn't running stable with 12.3. Yesterday I have downloaded and installed 12.3.1 to check if the problems using NetTrain are gone. I have loaded my ...
• 183
139 views

### How can I free GPU memory allocated with NetTrain

When I train a neural network with NetTrain[..., TargetDevice->"GPU"], wolfram's neural network code automatically allocates memory on my GPU for my ...
• 878
67 views

### Generating a sequence from a number using RNN

Can someone please provide me with a neat example about generating a sequence from a number using RNN? (Possibly without using NetGraph[].) Edit: I'm trying to ...
29 views

### Does NetChain have a "Distribution" property like PredictorFunction?

PredictorFunction has an incredibly useful "Distribution" property. In the past, this has helped me filter out bad predictions, like this: ...
117 views

### Upsampling layer for convolutional autoencoder

I've been trying to build a convolutional autoencoder with Mathematica 12.3. For this, I need to reverse the action of PoolingLayer[]. Is there any layer similar to ...
• 2,984
108 views

### Simulated Cartpole Example in Mathematica

I am interested in modifying the code underlying the reinforcement learning example SimulatedCartpole in Mathematica 12. This example is still listed as Experimental. The help function indicates that ...
• 131
269 views

### GAN LSTM Time Series

Does anyone know if it is possible to use LSTM or another RNN in GAN architecture as the generator? Here a reference: 1 Thx! To clarify, what I am asking is it possible in MMA 12.3 (my current version)...
• 131
1 vote
49 views

### Inputing pairs of objects to neural networks (eg. pairs of images and sounds)

I'm trying to make a net graph where the input (a pair of objects of distinct but fixed types) will be passed simultaneously trough two net encoders. One will get an array from the image (the first ...
• 862
109 views

### Neural network evaluate on multiple gpus simultaneously

For instance, I have 4 gpus, now I want to calculate neural network on each gpu simultaneously, or make use of all of my gpus to calculate the data. The code might like ...
1 vote
69 views

### FunctionLayer will calculate a distance matrix

I would like, that a FunctionLayer will calculate a distance matrix between two vectors. I try a following approach: ...
• 1,939
1 vote
42 views

### Is Parallelization of NetTrain possible?

I was planning to build a Neural Network model and create a list of the same model with the elements of the list being different Initializations of the same model. Is it possible to Train the entire ...
102 views

The possible values to specify the Padding option of a PaddingLayer include a fixed value, ...
• 1,995
1 vote
47 views

### Should this Dataset be Transposed for best Neural-Net Performance?

I've been working with this Kaggle dataset and intend to use it to make some time-series predictions from it. I've preprocessed it to the point where now I need to start making some decisions about ...
• 1,024
1 vote
136 views

### Is anyone aware of Mathematica implementation of OpenAI's GPT-3 API?

Is anyone aware of Mathematica's implementation of OpenAI's GPT-3 API?
• 361
I have a matrix $A_{m×n}$ and I want to assemble a network that performs $n$ different trainable linear transformations $T_{p×m}(i), i\in {1,2,...n}$ on its corresponding columns, (i.e. \$B^i = T(i)A^i)...