Skip to main content

Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
-1 votes
0 answers
26 views

Using a LSTM for time series forecasting

I found a Long Short-Term Memory (LSTM) network in the Wolfram Language (Mathematica), which implements it for simple arithmetic addition problems. The network is defined as follows: ...
Avgust K's user avatar
0 votes
1 answer
37 views

Neural network that augments the input with constants

Suppose we have a simple neural network as follows: ...
Math Gaudium's user avatar
0 votes
0 answers
44 views
+50

Improving accuracy of neural network for determining qubit rotation angle

The physics example problem (to illustrate the use of a basic neural network using Mathematica) I am looking at is a qubit rotated about the y-axis, where the rotation angle is discretized as $\...
John Doe's user avatar
  • 229
0 votes
0 answers
76 views

SoftmaxLayer with one-hot vectors

The quantum physics problem I am looking at is a rotated qubit. The setup involves a y-rotated qubit measured in the z-basis (hence spin-up and spin-down). This scenario typically includes modeling ...
John Doe's user avatar
  • 229
0 votes
0 answers
43 views

Using CrossEntropyLoss function for basic neural network

Hi I am interested in understanding how to use the neural network functions in Mathematica. I have just started learning hence this is a basic query. The simple example I am looking at is as follows: ...
John Doe's user avatar
  • 229
0 votes
1 answer
98 views

Need explanation on data[[i]][[1]]

I am trying to train a physics model and then check its profile. For this model, data for physics model is defined with: ...
Dean's user avatar
  • 655
1 vote
0 answers
30 views

TensorProduct in a FunctionLayer cannot compile correctly

My network can output an array of 6x512x512 size at the end, now I want to multiply an array of length 3 for each of these 6 channels to get the color of the different channels, I am using the ...
Schwarzer's user avatar
0 votes
0 answers
32 views

Modeling with different outputs size

I have lists of input and output. I want to perform the prediction operation but my outputs are different for each input and this causes an error. Can someone help me to write the model in such a way ...
Erfan's user avatar
  • 169
1 vote
2 answers
62 views

Define a ThreadingLayer involving list

As part of a larger net I am trying to define a ThreadingLayer but this results in an error: ...
b.gates.you.know.what's user avatar
4 votes
1 answer
74 views

EdgeLabels and EdgeLabelStyle of Graph

I try to name edges according to the nodes emerging from them and entering them. Each edge takes a specific name $e_{ij}$. The following example illustrates what is required ...
Emad kareem's user avatar
3 votes
0 answers
45 views

Ways to implement a unit-norm neural network weight constraint

In the popular neural network framework Keras one can constrain the learned weights in a LinearLayer to have a unit norm. For example: ...
Joshua Schrier's user avatar
0 votes
0 answers
38 views

How to treat small numbers in order to gain efficiency and precision in neural network algorithm?

Unfortunately I won't be able to provide a MWE, as it would be too big and complex, and this question will be based on pure semantics, basically (and I understand if this is impossible to answer in ...
GaloisFan's user avatar
  • 405
0 votes
0 answers
32 views

What is the network structure of Ademxapp Model A1 Trained on Cityscapes Data in the Mathematica?

I want to implement the model (Ademxapp Model A1 Trained on Cityscapes Data) on my data for segmentation, so I need the partial structure of this model, can anyone help?
Erfan's user avatar
  • 169
4 votes
1 answer
226 views

Q&A System using LLMSynthesize and Nearest

I'm looking for a Wolfram Q&A system that scales to 100k of text documents. Using Mathematica's similarity search (e.g. Nearest) or vector database operations (...
user5601's user avatar
  • 3,645
3 votes
1 answer
71 views

NetGraph won't accept EmbeddingLayers of different n

Why doesn't this work: ...
user233932's user avatar
1 vote
1 answer
138 views

Fitting smooth monotonic function (low number of points, irregular grid)

I want to fit data in the hope of obtaining an estimate for other data points (i.e. a good guess for the last 4 variables as a function of the first). Example data: ...
Kvothe's user avatar
  • 4,491
1 vote
0 answers
50 views

Any image captioning networks available yet?

Looking for an image captioning network to run in a notebook. I didn't see any on the NN Repo. Has anyone imported one successfully?
M.R.'s user avatar
  • 31.5k
3 votes
0 answers
324 views

Fourier neural operator using wolfram mathematica

Fourier Neural Operator (FNO) is a neural network-based approach that combines deep learning with the Fourier transform to solve partial differential equations. It leverages the power of neural ...
Baoxiang Pan's user avatar
1 vote
1 answer
112 views

Extract the latent space learned from a Neural Network

I would like to visualize and cluster vectors learned in the latent space of a Neural Network. I am trying to cluster audio tokens, but I don't know what they represent. So the task is to ...
user305883's user avatar
4 votes
1 answer
74 views

Is there a way to extract the function used in NetEncoder[{"Function", ... }]?

Is there a way — programmatically and with documented functions — to extract the function used in a NetEncoder[{"Function",...}] type encoder? I want to ...
Hbar's user avatar
  • 255
0 votes
0 answers
51 views

How could I draw a picture by connecting stars between them?

My idea is to try to make a program which would be able to trace a given picture in the sky, by simply connecting stars. Therefore, I have two questions. Is it possible to convert the product of an ...
Robin Raxel6's user avatar
1 vote
1 answer
136 views

Generating molecules using a GAN in Mathematica

I have been unable to find any tutorials or examples of creating molecules using a Generative Adversarial Network (GAN) in the Wolfram language. It appears that the Selfies paclet was created to ...
bhopshang's user avatar
  • 739
5 votes
0 answers
170 views

Target Device->"GPU" Not Working For Machine Learning: LibraryFunction error

I'm running Wolfram Desktop version 13.2.1, and after downloading Visual Studio, Nvidia Toolkit version 12.1 and 11.2, and verifying that ...
Daniel Berkowitz's user avatar
0 votes
1 answer
42 views

Sampling a new random ValidationSet at each epoch during NetTrain

My understanding is that the NetTrain option ValidationSet ->Scaled[0.2] setting will randomly sample 20% of the training data at the beginning of the fitting ...
Joshua Schrier's user avatar
0 votes
0 answers
75 views

Neural network: Segmentation of water and not water area

Good morning everyone. I have a large dataset of photographs similar to the one attached. It would be my intention to train a neural network to recognise water and "non-water" zones. How ...
Ramiro dell'Erba's user avatar
3 votes
1 answer
88 views

How to get the mathematical expression of a trained network?

When a network is trained, is it possible to get the corresponding mathematical expression? For instance consider this simple network: ...
anderstood's user avatar
  • 14.3k
4 votes
0 answers
85 views

TrainImageContentDetector example aborts on GPU

I'm running v13.2.1 on Ubuntu and trying to run the built-in examples. But I see a "GPU memory exhausted" error on the first one in the docs for ...
user5601's user avatar
  • 3,645
1 vote
0 answers
92 views

What is that neural network?

I am teaching my comp to add naturals by creating a neural network: ...
user64494's user avatar
  • 26.7k
2 votes
1 answer
145 views

How to add hidden layers and plot these?

I have a question regarding neural network graphs. In R there is the following code where a user can add hidden layers with different number of nodes: ...
Alkis Tsiatsios's user avatar
3 votes
1 answer
67 views

How to align the dimensions of Deconvolution in neural-net?

I tried to implement a NetGraph similar to UNet in Mathematica, but I found an error in the dimension. ...
Life_Checkpoint's user avatar
3 votes
0 answers
209 views

Why Mathematica's Classify gives 100% accuracy on FashionMNIST dataset

Tested on Mathematica 13.2 ...
HyperGroups's user avatar
  • 8,619
12 votes
4 answers
1k views

Text recognition - extracting table of text from image

I want to extract table from the image bellow as a list of strings. I tried the following but it does not work. ...
azerbajdzan's user avatar
  • 18.8k
3 votes
0 answers
127 views

Implementation of Restricted Boltzmann Machines?

A Restricted Boltzmann Machine is a classical and basic neural net method in Pattern Recognition and Machine Learning. We can easily find implementation in Matlab or Python, but are there any ...
HyperGroups's user avatar
  • 8,619
4 votes
0 answers
113 views

How to get an AWS VM to run Wolfram with a GPU (or Azure for that matter)

I have a neural network application that is too big for my Mac desktop. I've been looking at using RemoteBatchSubmit to Azure as a solution. I've gotten it to work using the base VM provided by Azure. ...
Seth Chandler's user avatar
17 votes
1 answer
561 views

Stable diffusion models in WL?

Are there any diffusion-based (text + image) -> image generation models available in Mathematica, Wolfram Repositories, or from third parties? In particular, I'm ...
M.R.'s user avatar
  • 31.5k
1 vote
0 answers
34 views

How to use Predict function with constraints on the output?

I have trained the Predict function with Method as "NeuralNetwork" to learn a function of an angle 0 < theta < 2 Pi, with period 2 Pi (the function returns a positive real number). I ...
Quasar Supernova's user avatar
2 votes
0 answers
59 views

Unable to Replicate an ANN Using the Output from Predict Function

I’m working on constructing an ANN. I first used the Predict function with the method “Neural Network” to determine the structure according to my data. This is the given output of the structure: ...
Nicole Gould's user avatar
20 votes
4 answers
971 views

Improve scanned image with handwritten text for high-contrast printing: how it can be done with Mathematica?

I have a set of scanned documents with handwritten text which by default is printed with very low contrast. Here is an example (a part of a document): ...
Alexey Popkov's user avatar
3 votes
0 answers
216 views

GAN Using Graph Convolution Network

I am using the Pokemon GAN tutorial in: https://blog.wolfram.com/2020/08/18/generative-adversarial-networks-gans-in-the-wolfram-language/ Where convolution blocks and deconvolution blocks are given by:...
user27478's user avatar
17 votes
2 answers
1k views

Diffusion probabilistic model in deep generative modeling

Diffusion Models (http://proceedings.mlr.press/v37/sohl-dickstein15.html and https://arxiv.org/abs/2006.11239) are generative models gaining popularity in the community of deep generative modeling, ...
Baoxiang Pan's user avatar
4 votes
0 answers
53 views

Training NetGraph with a 2nd order optician

I would like to train NetGraph using a quasi Newton algorithm rather than a first order stochastic gradient method. However, in NetTrain there are only such optimisers. Is there any way I can make ...
haro21's user avatar
  • 91
1 vote
0 answers
72 views

Why accuracy of Neural Network does not change as its structure is changed?

I have the following neural network: ...
FelipeAmorim's user avatar
5 votes
0 answers
129 views

Derivation from a network

how can I represent the derivative of a network (e.g. NetGraph or NetChain) as a network? I have tried it with FunctionLayer[] and NetPortGradient, but without success. I would be very pleased to ...
haro21's user avatar
  • 91
1 vote
0 answers
101 views

How to measure accuracy of a neural network?

I have this Neural Network for a specific data set: ...
FelipeAmorim's user avatar
3 votes
0 answers
129 views

Applying Super-Resolution to differently sized images

I would like to make some images larger and noticed that there is a page in the documentation for doing super-resolution using a network structure. It's called "A Model for Super-Resolution."...
bill s's user avatar
  • 69.1k
4 votes
1 answer
107 views

Does RandomArrayLayer implement the reparameterization trick?

I want to backpropagate through random operations (e.g. learn the mean and variance of a Gaussian random variable). I assumed that ...
Ian's user avatar
  • 101
3 votes
0 answers
85 views

Create "PredictorFunction" with NeuralNetwork

I tried to construct a predictor for a continuous variable using neural networks, something like f(a,b,c,d,e) = x, trying to predict x for a given set of a,b,c,d, and e. The builtin ...
enzo's user avatar
  • 131
2 votes
1 answer
92 views

How to make the output of NetTrain obey constraints?

Imagine I have this trained = NetTrain[LinearLayer[], {1 -> {0.1,0.7,0.2}, 2 -> {0,0,1}, 3 -> {0.4,0.4,0.2}, 4 -> {0.1,0.0,0.9}}] I want to ...
Quasar Supernova's user avatar
1 vote
1 answer
58 views

BasicRecurrentLayer with no bias and linear activation function?

Trying to design a small neural network for modeling a LTI system, I'd like to configure a BasicRecurrentLayer with these particular settings: No bias vector should be used (I've tried the option &...
Danel's user avatar
  • 173
6 votes
1 answer
185 views

Unexpected high memory consumption using out-of-core NetTrain

I'm working on training a neural network on an image dataset. There are 14k images and each image contains 3x150x150 pixels. I have built a generator function following the approach in Training on ...
Charmbracelet's user avatar

1
2 3 4 5
12