Questions tagged [neural-networks]
Questions involving defining, training, executing, importing and exporting neural networks.
478
questions
1
vote
1answer
16 views
Trying to train a NetGraph network generates an error
I'm trying to learn neural networks in the Wolfram language, so I've written the following code.
The input is a $2*3$ matrix, split into two parts. The parts are given to distinct linear layers, then ...
2
votes
0answers
27 views
5
votes
0answers
51 views
How to add an extra output port to an existing NetGraph?
I am using a pre-trained neural network which I downloaded from an ONNX repository. I would like to study the output of a given internal layer in the network.
Here is a simple dummy example of what I ...
1
vote
0answers
57 views
Replicating off-the-shelf ODE solvers
I've been working through some literature on ODEs and keep coming across the below pseudo-code expression and am having trouble interpreting it for use in the Wolfram Language. I feel like I've solved ...
2
votes
0answers
54 views
Loss function with regularization
The ML framework has a limited set of loss functions available. How can I extend this by creating my own custom ones?
For example, for L2-regularized training, Mathematica recommends
...
3
votes
0answers
75 views
Classify/NetTrain run indefinitely without output when using GPU
I am experimenting with Mathematica's Classify/NetTrain functions for the first time.
When I don't set a TargetDevice option, Mathematica defaults to the CPU and everything works as expected.
When I ...
1
vote
0answers
29 views
Not enough information was provided to fully specify the output of the NetEncoder
I using a UNET combined with a VGG16 network based loss function. The input of the UNET has an image netencoder attached to it, the output has an image netdecoder attached to it. The loss function ...
4
votes
1answer
197 views
Complex numbers in neural networks
I am trying to construct a neural network which fits a collection of functions from (complex-valued) vectors to complex numbers. After constructing a suitable network, I was surprised to see that ...
5
votes
1answer
65 views
Extracting array product from neural network
I'm training a neural network which is meant to model a collection of functions that map $N$-dimensional vectors to scalars. At this point, I have built up several layers which manipulate the input ...
1
vote
1answer
100 views
Does NetTrain Support Nvidia 30xx series GPU (RTX 3080, 3090 etc)?
Recently, I want to buy some 30xx series GPUs which are used to do deep learning jobs, so does anyone know whether Mathematica's NetTrain supports 30xx series GPUs?
6
votes
1answer
177 views
How to implement this custom NN layer (implement the Accumulate function in the layer)?
I will use this function layer to definte a custom LossFunction in the net.
How do I construct a NetGraph to implement this function?
5
votes
0answers
47 views
Fail to Export/Import seq2seq model (NER) to MXNet or ONNX
Mathematica 12.2 on Linux (Debian)
Here's a simple Named Entity Recognition model:
...
2
votes
1answer
84 views
How to build an RNN with input as character but output a sequence of tokens?
Let’s assume I have “abbcab”-> {“Apple”,”Banana”}, “Bibb”-> {“Carrot”} so the output is a sequence of various length, but I can pad it to be the same length. My problem, how do I create a ...
2
votes
1answer
28 views
What's the difference between train and test evaluation modes of a BatchNormalizationLayer?
After creating a BatchNormalizationLayer:
batchnorm = NetInitialize@BatchNormalizationLayer["Input" -> 3]
We can evaluate it in "Test" or &...
1
vote
1answer
60 views
How is the loss computed from the batch and round?
This is cross-posted from the forum.
I am trying to just reproduce the loss computed during training a very simple network. In this case the loss is just the standard L2 loss function.
Start with some ...
2
votes
1answer
60 views
Copying Weights using NetTrain in Mathematica
I would like to implement the PPO algorithm - Reinforcement Learning - in Mathematica. And for that, I need to be able to copy network weights from say subnetwork NN1 to subnetwork NN2 as an update ...
3
votes
0answers
33 views
Can NetNestOperator take a non pre-defined number of iterations?
I'd like to Nest a particular NetChain inside a larger NetGraph for a random number of ...
2
votes
0answers
25 views
Classify command option question
I'm using Classify to predict who is going to win a battle based on their strength. The input is something like {{"Name 1", Strength1},{"Name 2", Strength2},{"Name 3", ...
2
votes
0answers
52 views
Questions on NetMapOperator, NetNestOperator, NetFoldOperator [closed]
I've been playing around with the Higher-Order Network Construction functionality such as NetMapOperator, NetNestOperator, and <...
11
votes
0answers
186 views
Tutorial example NetTrain fails miserably with a GPU
I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
0
votes
1answer
54 views
Constructing Net problem
so I'm trying build a simple net that will help me find the winner in a competition. I would like to use as input "Name", "FA" and "Force", and obtain "Winner" ...
2
votes
2answers
86 views
how to implement training for UNET implementation on Wolfram Neural Net Repository?
My question is with reference to the U-NET implementation present on the Wolfram Neural Net Repository
The construction notebook present on the page (link: http://...
1
vote
0answers
44 views
Export and Import trained neural net
I have trained a neural network and would like to save it to disk. I am using Wolfram version 12.1.1.0 on Windows (64-bit). I have entered the following commands:
...
15
votes
1answer
228 views
Minibatch Standard Deviation Layer
I'm reworking some of the GANs I originally made in TensorFlow2 to see if I can improve performance in Mathematica, and have been stuck on how to create a custom Minibatch Standard Deviation Layer. I'...
4
votes
1answer
122 views
What is specifically the correct Generator output type?
I was constructing a GAN to analyze samples of timeseries with 3 features using a previous working template, and ran into the strangest error I haven't seen before. Some of my research so far suggests ...
4
votes
0answers
68 views
How to train each layer in a Neural Network so they optimize different loss functions in an adversarial network?
Example NetGraph to illustrate the idea (Input is an online signal with a value between -1 and 1, Noise is Gaussian Centered at 0 and standard deviation 0.1, EvilNet is constrained to output a value ...
1
vote
0answers
94 views
How to change/reinstall neural network runtime version?
I'm trying to run Mathematica on Azure instance with Tesla K80.
Setting TargetDevice->"GPU" produces the following set of errors for documentation page ...
2
votes
1answer
74 views
Want neural net example of rules {vector->string}
I am using data samples from a multispectral color sensor for color classification as an exercise in beginning to learn about neural networks.
I have succeeded with ...
2
votes
1answer
111 views
Help with creating the NetChain
I'm trying to train a network to take 3 integers and give an output = Max/Min. For example {10, 20, 30} -> 3. But I cannot get the setup correctly. I must be missing something.
...
8
votes
1answer
192 views
Deconvolution approaches for 3D data
Building neural nets in the WL is great. I was in the process of rewriting a previous GAN of mine in the WL to see if I can get better performance, and was surprised to find that the standard ...
1
vote
1answer
70 views
How to improve translating a list of points into a list of 3D volumes
I have a challenging transform I'm trying to accomplish as I try to improve the performance of my 3D GAN.
Background:
I've been working with data from Berkeley's PEER Ground Motion Database to ...
2
votes
0answers
87 views
Morphing between images
With Mathematica it is possible to continuously morph between images of different faces. But I was wondering if it is also possible to morph between images of any kind?
An example that uses Artbreeder ...
0
votes
0answers
86 views
2
votes
0answers
38 views
Change the size of the loss plot of the trained neural network
I am training with the simple a example of the documentation neural network (Link). I train the net, but and I don´t know how to change the size of the graphics of the loss plot. And when I try to see ...
0
votes
1answer
81 views
Custom function in Neural Network Layer
I am trying to create a custom function in a Neural Network. The output of the NN is a n x 2 matrix which represent coordinates of points in a plane. From this, the Euclidean pairwise distance matrix ...
0
votes
0answers
40 views
Data set for Neural Network
I am using Regression with Neural Networks and I want to set my train and test dataset.
But I have a huge dataset in Excel that obviously do not have the shape that Mathematica requires.
If I ...
3
votes
1answer
80 views
Visualisation of edges values on weight network [closed]
I have a problem when I want to see
values of edges on my weight graph.
...
2
votes
1answer
149 views
Neural Network Simple task
I'm trying to make a simple neural network to be able to find the y valeu given x1, x2 and x3. So first I made the training data:
...
1
vote
0answers
71 views
Create New Type of Layer For Neural Network
I'm doing some work exploring modelling neural networks in which each neuron could represent a different type of physical system. What I want to do is, I think, quite different to what an ordinary ...
4
votes
1answer
208 views
Save neural network after training
I've written quite a few projects that involve training a neural network through the Classify and Predict functions, but every ...
3
votes
3answers
207 views
Atypical graph partition
Suppose we have the given network 'graph', which we get based on the set 'edges':
...
1
vote
0answers
54 views
Importing A Neural Network From Mathematica For Use In R
I am experimenting with platform interoperability between Mathematica and R.
My aim is to create an untrained Neural Network using Mathematica, export this network in MXNet format as a .json file, ...
5
votes
0answers
146 views
How to efficiently implement a sub-pixel convolution layer in a CNN for image super-resolution
I am playing around using convolution neural networks for image super-resolution, i.e. up-scaling of images. In literature I often come across the concept of sub-pixel convolution as one of the ...
1
vote
0answers
36 views
How to define more general boundary conditions for ConvolutionLayer?
In Mathematica 12, I only see the option to define "PaddingSize" for a ConvolutionLayer in order to get Dirichlet boundary ...
2
votes
0answers
54 views
Are there any examples of pruning Neural Networks in Mathematica?
Are there any examples of Pruning in Neural Networks in Mathematica?
Any links or insight would be appreciated.
Thank You
Michel
0
votes
0answers
70 views
1
vote
0answers
44 views
Using LinearLayer for NetEncode[{“Characters”}]
So, I'm trying to make a net to translate a phrase. But I'm uncertain of the use of LinearLayer for a NetEncoder for Characters and getting some error in the training process. Here a toy example of ...
0
votes
0answers
52 views
Interpolated Hyperbolic tangent as a layer of a neural network
It is necessary to specify piecewise linear interpolation of the hyperbolic tangent. And substitute this function as a layer of a neural network. I tried a lot of things, please suggest your options.)
...
0
votes
0answers
62 views
Network training error InvalidJSON
I want to insert piecewise linear interpolation of the hyperbolic tangent into the neural network. An error occurs at the stage of training the network.
trainingData:
...
1
vote
2answers
113 views
Adding an interpolated function to neural networks through ElementwiseLayer
1.Trying to add an interpolated function to neural networks.
...
