Questions tagged [neural-networks]
Questions involving defining, training, executing, importing and exporting neural networks.
533
questions
4
votes
3
answers
95
views
How to detect chains (sequence of degree 2 vertices ) in a graph?
I am interested in finding the positions of "chains" (sequences of vertex degree 2 vertices) in a graph. I plan on collapsing these chains later to vertices with labels indicating that they ...
- 41
3
votes
0
answers
62
views
Applying Super-Resolution to differently sized images
I would like to make some images larger and noticed that there is a page in the documentation for doing super-resolution using a network structure. It's called "A Model for Super-Resolution."...
- 65.7k
1
vote
0
answers
45
views
Does RandomArrayLayer implement the reparameterization trick?
I want to backpropagate through random operations (e.g. learn the mean and variance of a Gaussian random variable). I assumed that
...
- 11
2
votes
0
answers
21
views
Create "PredictorFunction" with NeuralNetwork
I tried to construct a predictor for a continuous variable using neural networks, something like
f(a,b,c,d,e) = x,
trying to predict x for a given set of a,b,c,d, and e.
The builtin ...
- 21
0
votes
0
answers
25
views
Reshaping Output of a NetGraph during training
I'm trying to train a (per-pixel) segmentation neural net using the undocumented HDF5 training facilities that are laid out in this question. Here is a slightly modified version of the answer to that ...
- 710
2
votes
1
answer
64
views
How to make the output of NetTrain obey constraints?
Imagine I have this
trained = NetTrain[LinearLayer[], {1 -> {0.1,0.7,0.2}, 2 ->
{0,0,1}, 3 -> {0.4,0.4,0.2}, 4 -> {0.1,0.0,0.9}}]
I want to ...
- 1,398
1
vote
1
answer
36
views
BasicRecurrentLayer with no bias and linear activation function?
Trying to design a small neural network for modeling a LTI system, I'd like to configure a BasicRecurrentLayer with these particular settings:
No bias vector should be used (I've tried the option &...
- 123
5
votes
1
answer
114
views
Unexpected high memory consumption using out-of-core NetTrain
I'm working on training a neural network on an image dataset. There are 14k images and each image contains 3x150x150 pixels. I have built a generator function following the approach in Training on ...
- 376
4
votes
1
answer
145
views
Constructing neural networks from Keras example
I am trying to convert neural networks from a book to Wolfram language. The book has this example with the quote
two layers of 10 neurons and a dropout of 0.2 for each
...
- 483
0
votes
0
answers
30
views
Transfer Learning Model in two ways
I have tried a lot. But no method can't work. How to correct it?
The link is the code below.
Dataset Preparation -> blancedTrain, blancedTest
...
- 1
2
votes
1
answer
70
views
CrossValidate for image classification with NetTrain
I am trying to set up transfer learning using instructions from this repository page on EfficientNet. I am able to perform a stand-alone training and testing using the instructions on that page. The ...
- 483
2
votes
0
answers
33
views
Neural Nets: Can the back propagation/deep dream step be computed within the Net itself
I am trying see if I can do a deep dreaming algorithm without exiting a neural net.
This Generalized Backpropagation for Neural Networks (e.g. DeepDream) has a nice discussion of using the ...
- 2,058
1
vote
1
answer
81
views
Is there a difference between ElementwiseLayer@Ramp and Ramp in NetGraph?
This is about neural net! I put what I want to ask in the picture! This is the code!
...
- 41
0
votes
0
answers
31
views
Ranges of ANN predict values too narrow
I plan to train a neural network on a large dataset. Each example contain 16 parameters (inputs) and 1 output. A snapshot of the dataset looks like:
net = ParallelTable[Parasets[[i]] -> {degraeffr[...
0
votes
0
answers
42
views
How to manipulate neural network output data?
I have a large list data for neural network training in the form
{x1 -> y1, … , xn -> yn}
Where the outputs $y_i$ is either 1 or 0 and the inputs $x_i$ are ...
- 285
2
votes
0
answers
29
views
EmbeddingLayer with variable input length is incompatible with LinearLayer?
EmbeddingLayer\[size, n\] trains a representation of a list of integers between 1 and n into a real vector of dimension ...
- 2,360
7
votes
1
answer
194
views
Exactly recreating image NetEncoder output
I need to run an exported NetChain in ONNX, surprisingly the model exports and runs successfully, but there's a discrepancy in the image loading stage (the NetEncoder'ing that must be written manually)...
- 3,720
0
votes
0
answers
43
views
Spliting training dataset in ANN training using NetTrain
I am training a neural network on large training dataset containing 25,525,200 examples. each example contain 15 parameters (inputs) and 1 output, such as
Inputs 0.015,83.6,0.663,0.104,0.097,0.167,0....
3
votes
1
answer
76
views
Automated mapping between input and output columns of FeatureExtractorFunctions
This problem is about FeatureExtraction. It arose in the course of training a neural network where the data contains a mixture of nominal and numeric variables. Basically, my code looks like the ...
- 2,962
1
vote
0
answers
29
views
Repeated calculation with neural network measurement slows down
I have a list of 200 neural nets nets0. I have to measure the output of several layers of each of them on a list of 1000 associations ...
- 195
1
vote
0
answers
88
views
Increase the speed of Machine learning based on 'Predict'
I am training a ANN model with a large dataset (~million level) using Predict or NetTrain function. I do not have a GPU machine but have a server equipped with 16 CPU cores. How can I maximize the ...
1
vote
0
answers
79
views
Unknown Error in NetGraph with RTX 3090 GPU
I am running NetGraph on my RTX 3090 GPU. The Net itself loads properly in my GPU, having an approximate size of 9GB (the 3090 has 24GB of memory). However, once the net actually starts NetGraph ...
6
votes
1
answer
72
views
How to calculate a PDF of a neural network output?
I have to find the probability density function of the output of an internal layer in a neural network.
I wanted to do it using NetMeasurements adding a layer like
<...
- 195
4
votes
1
answer
53
views
`NetNestOperator` with custom input / output ports
I'd like to use NetNestOperator on a NetGraph that has custom input / output port names, such as
...
- 1,995
16
votes
0
answers
319
views
Neural Network Automatic Differentiation ("Autograd")
Automatic differentiation methods in general have been the topic of past questions, but this is specifically about automatic differentiation of neural networks.
The motivation is an old but useful ...
- 2,360
4
votes
1
answer
102
views
Prevent overfitting in Predict function
I know that you can prevent overtraining automatically in a network if you use NetTrain with NetChain in Mathematica version 12, ...
- 489
13
votes
1
answer
398
views
Wolfram Neural Net Repository Questions
I am a research scientist in the machine learning team, and mostly involved with the neural net repository. One of the discussions with my group raised these question in my mind, and these might be ...
- 131
1
vote
0
answers
32
views
Problems extracting a layer from a deep network
I am trying to reproduce this deep net for pose estimation. (v. 11.3, MacOS)
I download the VGG network, as specified:
...
- 35.8k
0
votes
0
answers
60
views
Mathematica accuracy errors when creating data
I created training data for a neural network and below are two errors I got
The only code that uses "FindRoot" command is the following
...
- 285
0
votes
0
answers
47
views
0
votes
1
answer
43
views
Error Using NetMeasurements (assessing neural network performance)
I am trying to assess how well a neural network regression model performs on test data. To do this I have used NetMeasurements command.
...
- 285
1
vote
1
answer
139
views
Building multilayer perceptron Neural Network
I’m new to machine learning and am a bit confused about how to create a neural network (multilayer perceptron) with a specific design.
I would like to create a neural network with 40 features/neurones ...
- 285
0
votes
0
answers
38
views
Convolution layer input size error
I have network which I want to take in a $6 \times 2761$ 'image' and output into one of three classifications. I have 240 of these images that I would like to train with. My training list therefore ...
- 169
2
votes
1
answer
125
views
Anyone has any succes on GPU NetTrain with RemoteBatchSubmit on AWS EC2?
Since 12.3, the RemoteBatchSubmit to EC2 does not work anymore.
First, it features the same bug as Version 12.3.1 Problems with NetTrain, where the MXNetResources paclet is 12.4 instead of 12.3.
...
9
votes
3
answers
525
views
Version 12.3.1 Problems with NetTrain
Until now I am using MMA 12.2 because NetTrain istn't running stable with 12.3.
Yesterday I have downloaded and installed 12.3.1 to check if the problems using NetTrain are gone.
I have loaded my ...
- 183
4
votes
0
answers
139
views
How can I free GPU memory allocated with NetTrain
When I train a neural network with NetTrain[..., TargetDevice->"GPU"], wolfram's neural network code automatically allocates memory on my GPU for my ...
- 878
0
votes
0
answers
67
views
Generating a sequence from a number using RNN
Can someone please provide me with a neat example about generating a sequence from a number using RNN? (Possibly without using NetGraph[].)
Edit:
I'm trying to ...
2
votes
0
answers
29
views
Does NetChain have a "Distribution" property like PredictorFunction?
PredictorFunction has an incredibly useful "Distribution" property. In the past, this has helped me filter out bad predictions, like this:
...
2
votes
1
answer
117
views
Upsampling layer for convolutional autoencoder
I've been trying to build a convolutional autoencoder with Mathematica 12.3. For this, I need to reverse the action of PoolingLayer[]. Is there any layer similar to ...
- 2,984
2
votes
0
answers
108
views
Simulated Cartpole Example in Mathematica
I am interested in modifying the code underlying the reinforcement learning example SimulatedCartpole in Mathematica 12.
This example is still listed as Experimental. The help function indicates that ...
- 131
3
votes
1
answer
269
views
GAN LSTM Time Series
Does anyone know if it is possible to use LSTM or another RNN in GAN architecture as the generator? Here a reference: 1
Thx!
To clarify, what I am asking is it possible in MMA 12.3 (my current version)...
- 131
1
vote
0
answers
49
views
Inputing pairs of objects to neural networks (eg. pairs of images and sounds)
I'm trying to make a net graph where the input (a pair of objects of distinct but fixed types) will be passed simultaneously trough two net encoders. One will get an array from the image (the first ...
- 862
2
votes
1
answer
109
views
Neural network evaluate on multiple gpus simultaneously
For instance, I have 4 gpus, now I want to calculate neural network on each gpu simultaneously, or make use of all of my gpus to calculate the data.
The code might like
...
- 93
1
vote
1
answer
69
views
`FunctionLayer` will calculate a distance matrix
I would like, that a FunctionLayer will calculate a distance matrix between two vectors.
I try a following approach:
...
- 1,939
1
vote
0
answers
42
views
Is Parallelization of NetTrain possible?
I was planning to build a Neural Network model and create a list of the same model with the elements of the list being different Initializations of the same model.
Is it possible to Train the entire ...
- 11
2
votes
1
answer
102
views
Periodic PaddingLayer
The possible values to specify the Padding option of a PaddingLayer include a fixed value, ...
- 1,995
1
vote
0
answers
47
views
Should this Dataset be Transposed for best Neural-Net Performance?
I've been working with this Kaggle dataset and intend to use it to make some time-series predictions from it. I've preprocessed it to the point where now I need to start making some decisions about ...
- 1,024
1
vote
0
answers
136
views
Is anyone aware of Mathematica implementation of OpenAI's GPT-3 API?
Is anyone aware of Mathematica's implementation of OpenAI's GPT-3 API?
- 361
3
votes
1
answer
95
views
How to partition variable length vectors via mathematica's neural network?
I need to partition variable length vectors in neural network recently. For instance, the network input is {1,2,3,4,...,2n}, I want to partition two elements as a ...
- 93
1
vote
2
answers
90
views
How to assemble layers to perform different linear transformations on each column of matrix?
I have a matrix $A_{m×n}$ and I want to assemble a network that performs $n$ different trainable linear transformations $T_{p×m}(i), i\in {1,2,...n}$ on its corresponding columns, (i.e. $B^i = T(i)A^i)...
- 13