Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
4 votes
3 answers
95 views

How to detect chains (sequence of degree 2 vertices ) in a graph?

I am interested in finding the positions of "chains" (sequences of vertex degree 2 vertices) in a graph. I plan on collapsing these chains later to vertices with labels indicating that they ...
user avatar
3 votes
0 answers
62 views

Applying Super-Resolution to differently sized images

I would like to make some images larger and noticed that there is a page in the documentation for doing super-resolution using a network structure. It's called "A Model for Super-Resolution."...
user avatar
  • 65.7k
1 vote
0 answers
45 views

Does RandomArrayLayer implement the reparameterization trick?

I want to backpropagate through random operations (e.g. learn the mean and variance of a Gaussian random variable). I assumed that ...
user avatar
  • 11
2 votes
0 answers
21 views

Create "PredictorFunction" with NeuralNetwork

I tried to construct a predictor for a continuous variable using neural networks, something like f(a,b,c,d,e) = x, trying to predict x for a given set of a,b,c,d, and e. The builtin ...
user avatar
  • 21
0 votes
0 answers
25 views

Reshaping Output of a NetGraph during training

I'm trying to train a (per-pixel) segmentation neural net using the undocumented HDF5 training facilities that are laid out in this question. Here is a slightly modified version of the answer to that ...
user avatar
  • 710
2 votes
1 answer
64 views

How to make the output of NetTrain obey constraints?

Imagine I have this trained = NetTrain[LinearLayer[], {1 -> {0.1,0.7,0.2}, 2 -> {0,0,1}, 3 -> {0.4,0.4,0.2}, 4 -> {0.1,0.0,0.9}}] I want to ...
user avatar
1 vote
1 answer
36 views

BasicRecurrentLayer with no bias and linear activation function?

Trying to design a small neural network for modeling a LTI system, I'd like to configure a BasicRecurrentLayer with these particular settings: No bias vector should be used (I've tried the option &...
user avatar
  • 123
5 votes
1 answer
114 views

Unexpected high memory consumption using out-of-core NetTrain

I'm working on training a neural network on an image dataset. There are 14k images and each image contains 3x150x150 pixels. I have built a generator function following the approach in Training on ...
user avatar
4 votes
1 answer
145 views

Constructing neural networks from Keras example

I am trying to convert neural networks from a book to Wolfram language. The book has this example with the quote two layers of 10 neurons and a dropout of 0.2 for each ...
user avatar
  • 483
0 votes
0 answers
30 views

Transfer Learning Model in two ways

I have tried a lot. But no method can't work. How to correct it? The link is the code below. Dataset Preparation -> blancedTrain, blancedTest ...
user avatar
  • 1
2 votes
1 answer
70 views

CrossValidate for image classification with NetTrain

I am trying to set up transfer learning using instructions from this repository page on EfficientNet. I am able to perform a stand-alone training and testing using the instructions on that page. The ...
user avatar
  • 483
2 votes
0 answers
33 views

Neural Nets: Can the back propagation/deep dream step be computed within the Net itself

I am trying see if I can do a deep dreaming algorithm without exiting a neural net. This Generalized Backpropagation for Neural Networks (e.g. DeepDream) has a nice discussion of using the ...
user avatar
  • 2,058
1 vote
1 answer
81 views

Is there a difference between ElementwiseLayer@Ramp and Ramp in NetGraph?

This is about neural net! I put what I want to ask in the picture! This is the code! ...
user avatar
0 votes
0 answers
31 views

Ranges of ANN predict values too narrow

I plan to train a neural network on a large dataset. Each example contain 16 parameters (inputs) and 1 output. A snapshot of the dataset looks like: net = ParallelTable[Parasets[[i]] -> {degraeffr[...
user avatar
0 votes
0 answers
42 views

How to manipulate neural network output data?

I have a large list data for neural network training in the form {x1 -> y1, … , xn -> yn} Where the outputs $y_i$ is either 1 or 0 and the inputs $x_i$ are ...
user avatar
  • 285
2 votes
0 answers
29 views

EmbeddingLayer with variable input length is incompatible with LinearLayer?

EmbeddingLayer\[size, n\] trains a representation of a list of integers between 1 and n into a real vector of dimension ...
user avatar
7 votes
1 answer
194 views

Exactly recreating image NetEncoder output

I need to run an exported NetChain in ONNX, surprisingly the model exports and runs successfully, but there's a discrepancy in the image loading stage (the NetEncoder'ing that must be written manually)...
user avatar
  • 3,720
0 votes
0 answers
43 views

Spliting training dataset in ANN training using NetTrain

I am training a neural network on large training dataset containing 25,525,200 examples. each example contain 15 parameters (inputs) and 1 output, such as Inputs 0.015,83.6,0.663,0.104,0.097,0.167,0....
user avatar
3 votes
1 answer
76 views

Automated mapping between input and output columns of FeatureExtractorFunctions

This problem is about FeatureExtraction. It arose in the course of training a neural network where the data contains a mixture of nominal and numeric variables. Basically, my code looks like the ...
user avatar
1 vote
0 answers
29 views

Repeated calculation with neural network measurement slows down

I have a list of 200 neural nets nets0. I have to measure the output of several layers of each of them on a list of 1000 associations ...
user avatar
  • 195
1 vote
0 answers
88 views

Increase the speed of Machine learning based on 'Predict'

I am training a ANN model with a large dataset (~million level) using Predict or NetTrain function. I do not have a GPU machine but have a server equipped with 16 CPU cores. How can I maximize the ...
user avatar
1 vote
0 answers
79 views

Unknown Error in NetGraph with RTX 3090 GPU

I am running NetGraph on my RTX 3090 GPU. The Net itself loads properly in my GPU, having an approximate size of 9GB (the 3090 has 24GB of memory). However, once the net actually starts NetGraph ...
user avatar
6 votes
1 answer
72 views

How to calculate a PDF of a neural network output?

I have to find the probability density function of the output of an internal layer in a neural network. I wanted to do it using NetMeasurements adding a layer like <...
user avatar
  • 195
4 votes
1 answer
53 views

`NetNestOperator` with custom input / output ports

I'd like to use NetNestOperator on a NetGraph that has custom input / output port names, such as ...
user avatar
16 votes
0 answers
319 views

Neural Network Automatic Differentiation ("Autograd")

Automatic differentiation methods in general have been the topic of past questions, but this is specifically about automatic differentiation of neural networks. The motivation is an old but useful ...
user avatar
4 votes
1 answer
102 views

Prevent overfitting in Predict function

I know that you can prevent overtraining automatically in a network if you use NetTrain with NetChain in Mathematica version 12, ...
user avatar
  • 489
13 votes
1 answer
398 views

Wolfram Neural Net Repository Questions

I am a research scientist in the machine learning team, and mostly involved with the neural net repository. One of the discussions with my group raised these question in my mind, and these might be ...
user avatar
1 vote
0 answers
32 views

Problems extracting a layer from a deep network

I am trying to reproduce this deep net for pose estimation. (v. 11.3, MacOS) I download the VGG network, as specified: ...
user avatar
0 votes
0 answers
60 views

Mathematica accuracy errors when creating data

I created training data for a neural network and below are two errors I got The only code that uses "FindRoot" command is the following ...
user avatar
  • 285
0 votes
0 answers
47 views

How to connect NetEncoder to LinearLayer

While using Encoder and LinearLayer separately ...
user avatar
0 votes
1 answer
43 views

Error Using NetMeasurements (assessing neural network performance)

I am trying to assess how well a neural network regression model performs on test data. To do this I have used NetMeasurements command. ...
user avatar
  • 285
1 vote
1 answer
139 views

Building multilayer perceptron Neural Network

I’m new to machine learning and am a bit confused about how to create a neural network (multilayer perceptron) with a specific design. I would like to create a neural network with 40 features/neurones ...
user avatar
  • 285
0 votes
0 answers
38 views

Convolution layer input size error

I have network which I want to take in a $6 \times 2761$ 'image' and output into one of three classifications. I have 240 of these images that I would like to train with. My training list therefore ...
user avatar
  • 169
2 votes
1 answer
125 views

Anyone has any succes on GPU NetTrain with RemoteBatchSubmit on AWS EC2?

Since 12.3, the RemoteBatchSubmit to EC2 does not work anymore. First, it features the same bug as Version 12.3.1 Problems with NetTrain, where the MXNetResources paclet is 12.4 instead of 12.3. ...
user avatar
9 votes
3 answers
525 views

Version 12.3.1 Problems with NetTrain

Until now I am using MMA 12.2 because NetTrain istn't running stable with 12.3. Yesterday I have downloaded and installed 12.3.1 to check if the problems using NetTrain are gone. I have loaded my ...
user avatar
4 votes
0 answers
139 views

How can I free GPU memory allocated with NetTrain

When I train a neural network with NetTrain[..., TargetDevice->"GPU"], wolfram's neural network code automatically allocates memory on my GPU for my ...
user avatar
0 votes
0 answers
67 views

Generating a sequence from a number using RNN

Can someone please provide me with a neat example about generating a sequence from a number using RNN? (Possibly without using NetGraph[].) Edit: I'm trying to ...
user avatar
2 votes
0 answers
29 views

Does NetChain have a "Distribution" property like PredictorFunction?

PredictorFunction has an incredibly useful "Distribution" property. In the past, this has helped me filter out bad predictions, like this: ...
user avatar
2 votes
1 answer
117 views

Upsampling layer for convolutional autoencoder

I've been trying to build a convolutional autoencoder with Mathematica 12.3. For this, I need to reverse the action of PoolingLayer[]. Is there any layer similar to ...
user avatar
  • 2,984
2 votes
0 answers
108 views

Simulated Cartpole Example in Mathematica

I am interested in modifying the code underlying the reinforcement learning example SimulatedCartpole in Mathematica 12. This example is still listed as Experimental. The help function indicates that ...
user avatar
  • 131
3 votes
1 answer
269 views

GAN LSTM Time Series

Does anyone know if it is possible to use LSTM or another RNN in GAN architecture as the generator? Here a reference: 1 Thx! To clarify, what I am asking is it possible in MMA 12.3 (my current version)...
user avatar
  • 131
1 vote
0 answers
49 views

Inputing pairs of objects to neural networks (eg. pairs of images and sounds)

I'm trying to make a net graph where the input (a pair of objects of distinct but fixed types) will be passed simultaneously trough two net encoders. One will get an array from the image (the first ...
user avatar
2 votes
1 answer
109 views

Neural network evaluate on multiple gpus simultaneously

For instance, I have 4 gpus, now I want to calculate neural network on each gpu simultaneously, or make use of all of my gpus to calculate the data. The code might like ...
user avatar
1 vote
1 answer
69 views

`FunctionLayer` will calculate a distance matrix

I would like, that a FunctionLayer will calculate a distance matrix between two vectors. I try a following approach: ...
user avatar
1 vote
0 answers
42 views

Is Parallelization of NetTrain possible?

I was planning to build a Neural Network model and create a list of the same model with the elements of the list being different Initializations of the same model. Is it possible to Train the entire ...
user avatar
2 votes
1 answer
102 views

Periodic PaddingLayer

The possible values to specify the Padding option of a PaddingLayer include a fixed value, ...
user avatar
1 vote
0 answers
47 views

Should this Dataset be Transposed for best Neural-Net Performance?

I've been working with this Kaggle dataset and intend to use it to make some time-series predictions from it. I've preprocessed it to the point where now I need to start making some decisions about ...
user avatar
  • 1,024
1 vote
0 answers
136 views

Is anyone aware of Mathematica implementation of OpenAI's GPT-3 API?

Is anyone aware of Mathematica's implementation of OpenAI's GPT-3 API?
user avatar
  • 361
3 votes
1 answer
95 views

How to partition variable length vectors via mathematica's neural network?

I need to partition variable length vectors in neural network recently. For instance, the network input is {1,2,3,4,...,2n}, I want to partition two elements as a ...
user avatar
1 vote
2 answers
90 views

How to assemble layers to perform different linear transformations on each column of matrix?

I have a matrix $A_{m×n}$ and I want to assemble a network that performs $n$ different trainable linear transformations $T_{p×m}(i), i\in {1,2,...n}$ on its corresponding columns, (i.e. $B^i = T(i)A^i)...
user avatar

1
2 3 4 5
11