Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
1
vote
1answer
16 views

Trying to train a NetGraph network generates an error

I'm trying to learn neural networks in the Wolfram language, so I've written the following code. The input is a $2*3$ matrix, split into two parts. The parts are given to distinct linear layers, then ...
2
votes
0answers
27 views

Extracting information from Classify

I have used Mathematica's automated Classify function: ...
5
votes
0answers
51 views

How to add an extra output port to an existing NetGraph?

I am using a pre-trained neural network which I downloaded from an ONNX repository. I would like to study the output of a given internal layer in the network. Here is a simple dummy example of what I ...
1
vote
0answers
57 views

Replicating off-the-shelf ODE solvers

I've been working through some literature on ODEs and keep coming across the below pseudo-code expression and am having trouble interpreting it for use in the Wolfram Language. I feel like I've solved ...
2
votes
0answers
54 views

Loss function with regularization

The ML framework has a limited set of loss functions available. How can I extend this by creating my own custom ones? For example, for L2-regularized training, Mathematica recommends ...
3
votes
0answers
75 views

Classify/NetTrain run indefinitely without output when using GPU

I am experimenting with Mathematica's Classify/NetTrain functions for the first time. When I don't set a TargetDevice option, Mathematica defaults to the CPU and everything works as expected. When I ...
1
vote
0answers
29 views

Not enough information was provided to fully specify the output of the NetEncoder

I using a UNET combined with a VGG16 network based loss function. The input of the UNET has an image netencoder attached to it, the output has an image netdecoder attached to it. The loss function ...
4
votes
1answer
197 views

Complex numbers in neural networks

I am trying to construct a neural network which fits a collection of functions from (complex-valued) vectors to complex numbers. After constructing a suitable network, I was surprised to see that ...
5
votes
1answer
65 views

Extracting array product from neural network

I'm training a neural network which is meant to model a collection of functions that map $N$-dimensional vectors to scalars. At this point, I have built up several layers which manipulate the input ...
1
vote
1answer
100 views

Does NetTrain Support Nvidia 30xx series GPU (RTX 3080, 3090 etc)?

Recently, I want to buy some 30xx series GPUs which are used to do deep learning jobs, so does anyone know whether Mathematica's NetTrain supports 30xx series GPUs?
6
votes
1answer
177 views

How to implement this custom NN layer (implement the Accumulate function in the layer)?

I will use this function layer to definte a custom LossFunction in the net. How do I construct a NetGraph to implement this function?
5
votes
0answers
47 views

Fail to Export/Import seq2seq model (NER) to MXNet or ONNX

Mathematica 12.2 on Linux (Debian) Here's a simple Named Entity Recognition model: ...
2
votes
1answer
84 views

How to build an RNN with input as character but output a sequence of tokens?

Let’s assume I have “abbcab”-> {“Apple”,”Banana”}, “Bibb”-> {“Carrot”} so the output is a sequence of various length, but I can pad it to be the same length. My problem, how do I create a ...
2
votes
1answer
28 views

What's the difference between train and test evaluation modes of a BatchNormalizationLayer?

After creating a BatchNormalizationLayer: batchnorm = NetInitialize@BatchNormalizationLayer["Input" -> 3] We can evaluate it in "Test" or &...
1
vote
1answer
60 views

How is the loss computed from the batch and round?

This is cross-posted from the forum. I am trying to just reproduce the loss computed during training a very simple network. In this case the loss is just the standard L2 loss function. Start with some ...
2
votes
1answer
60 views

Copying Weights using NetTrain in Mathematica

I would like to implement the PPO algorithm - Reinforcement Learning - in Mathematica. And for that, I need to be able to copy network weights from say subnetwork NN1 to subnetwork NN2 as an update ...
3
votes
0answers
33 views

Can NetNestOperator take a non pre-defined number of iterations?

I'd like to Nest a particular NetChain inside a larger NetGraph for a random number of ...
2
votes
0answers
25 views

Classify command option question

I'm using Classify to predict who is going to win a battle based on their strength. The input is something like {{"Name 1", Strength1},{"Name 2", Strength2},{"Name 3", ...
2
votes
0answers
52 views

Questions on NetMapOperator, NetNestOperator, NetFoldOperator [closed]

I've been playing around with the Higher-Order Network Construction functionality such as NetMapOperator, NetNestOperator, and <...
11
votes
0answers
186 views

Tutorial example NetTrain fails miserably with a GPU

I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
0
votes
1answer
54 views

Constructing Net problem

so I'm trying build a simple net that will help me find the winner in a competition. I would like to use as input "Name", "FA" and "Force", and obtain "Winner" ...
2
votes
2answers
86 views

how to implement training for UNET implementation on Wolfram Neural Net Repository?

My question is with reference to the U-NET implementation present on the Wolfram Neural Net Repository The construction notebook present on the page (link: http://...
1
vote
0answers
44 views

Export and Import trained neural net

I have trained a neural network and would like to save it to disk. I am using Wolfram version 12.1.1.0 on Windows (64-bit). I have entered the following commands: ...
15
votes
1answer
228 views

Minibatch Standard Deviation Layer

I'm reworking some of the GANs I originally made in TensorFlow2 to see if I can improve performance in Mathematica, and have been stuck on how to create a custom Minibatch Standard Deviation Layer. I'...
4
votes
1answer
122 views

What is specifically the correct Generator output type?

I was constructing a GAN to analyze samples of timeseries with 3 features using a previous working template, and ran into the strangest error I haven't seen before. Some of my research so far suggests ...
4
votes
0answers
68 views

How to train each layer in a Neural Network so they optimize different loss functions in an adversarial network?

Example NetGraph to illustrate the idea (Input is an online signal with a value between -1 and 1, Noise is Gaussian Centered at 0 and standard deviation 0.1, EvilNet is constrained to output a value ...
1
vote
0answers
94 views

How to change/reinstall neural network runtime version?

I'm trying to run Mathematica on Azure instance with Tesla K80. Setting TargetDevice->"GPU" produces the following set of errors for documentation page ...
2
votes
1answer
74 views

Want neural net example of rules {vector->string}

I am using data samples from a multispectral color sensor for color classification as an exercise in beginning to learn about neural networks. I have succeeded with ...
2
votes
1answer
111 views

Help with creating the NetChain

I'm trying to train a network to take 3 integers and give an output = Max/Min. For example {10, 20, 30} -> 3. But I cannot get the setup correctly. I must be missing something. ...
8
votes
1answer
192 views

Deconvolution approaches for 3D data

Building neural nets in the WL is great. I was in the process of rewriting a previous GAN of mine in the WL to see if I can get better performance, and was surprised to find that the standard ...
1
vote
1answer
70 views

How to improve translating a list of points into a list of 3D volumes

I have a challenging transform I'm trying to accomplish as I try to improve the performance of my 3D GAN. Background: I've been working with data from Berkeley's PEER Ground Motion Database to ...
2
votes
0answers
87 views

Morphing between images

With Mathematica it is possible to continuously morph between images of different faces. But I was wondering if it is also possible to morph between images of any kind? An example that uses Artbreeder ...
0
votes
0answers
86 views

From graph to time series

Let's consider the time series: ...
2
votes
0answers
38 views

Change the size of the loss plot of the trained neural network

I am training with the simple a example of the documentation neural network (Link). I train the net, but and I don´t know how to change the size of the graphics of the loss plot. And when I try to see ...
0
votes
1answer
81 views

Custom function in Neural Network Layer

I am trying to create a custom function in a Neural Network. The output of the NN is a n x 2 matrix which represent coordinates of points in a plane. From this, the Euclidean pairwise distance matrix ...
0
votes
0answers
40 views

Data set for Neural Network

I am using Regression with Neural Networks and I want to set my train and test dataset. But I have a huge dataset in Excel that obviously do not have the shape that Mathematica requires. If I ...
3
votes
1answer
80 views

Visualisation of edges values on weight network [closed]

I have a problem when I want to see values of edges on my weight graph. ...
2
votes
1answer
149 views

Neural Network Simple task

I'm trying to make a simple neural network to be able to find the y valeu given x1, x2 and x3. So first I made the training data: ...
1
vote
0answers
71 views

Create New Type of Layer For Neural Network

I'm doing some work exploring modelling neural networks in which each neuron could represent a different type of physical system. What I want to do is, I think, quite different to what an ordinary ...
4
votes
1answer
208 views

Save neural network after training

I've written quite a few projects that involve training a neural network through the Classify and Predict functions, but every ...
3
votes
3answers
207 views

Atypical graph partition

Suppose we have the given network 'graph', which we get based on the set 'edges': ...
1
vote
0answers
54 views

Importing A Neural Network From Mathematica For Use In R

I am experimenting with platform interoperability between Mathematica and R. My aim is to create an untrained Neural Network using Mathematica, export this network in MXNet format as a .json file, ...
5
votes
0answers
146 views

How to efficiently implement a sub-pixel convolution layer in a CNN for image super-resolution

I am playing around using convolution neural networks for image super-resolution, i.e. up-scaling of images. In literature I often come across the concept of sub-pixel convolution as one of the ...
1
vote
0answers
36 views

How to define more general boundary conditions for ConvolutionLayer?

In Mathematica 12, I only see the option to define "PaddingSize" for a ConvolutionLayer in order to get Dirichlet boundary ...
2
votes
0answers
54 views

Are there any examples of pruning Neural Networks in Mathematica?

Are there any examples of Pruning in Neural Networks in Mathematica? Any links or insight would be appreciated. Thank You Michel
0
votes
0answers
70 views

Neural network symbolic inputs and weights

If I create a neural network like, for example, so: ...
1
vote
0answers
44 views

Using LinearLayer for NetEncode[{“Characters”}]

So, I'm trying to make a net to translate a phrase. But I'm uncertain of the use of LinearLayer for a NetEncoder for Characters and getting some error in the training process. Here a toy example of ...
0
votes
0answers
52 views

Interpolated Hyperbolic tangent as a layer of a neural network

It is necessary to specify piecewise linear interpolation of the hyperbolic tangent. And substitute this function as a layer of a neural network. I tried a lot of things, please suggest your options.) ...
0
votes
0answers
62 views

Network training error InvalidJSON

I want to insert piecewise linear interpolation of the hyperbolic tangent into the neural network. An error occurs at the stage of training the network. trainingData: ...
1
vote
2answers
113 views

Adding an interpolated function to neural networks through ElementwiseLayer

1.Trying to add an interpolated function to neural networks. ...

1
2 3 4 5
10