Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
0
votes
0answers
34 views

Repeatedly download a NetModel

NetModel["Wolfram AudioIdentify V1 Trained on AudioSet Data"] I can download the NetModel, but once I quit the kernel, next time I should download the NetModel ...
4
votes
1answer
99 views

Scalar vs vector of size 1 in neural networks

I've been playing with Mathematica's neural network functions, and I keep getting stuck on the same annoying problem. Often Mathematica declares that the output of my neural network is a vector of ...
19
votes
0answers
620 views

How to ImageRestyle high-res images?

I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels. All the examples in the documentation use images around 500 x 500 or ...
0
votes
1answer
77 views

On Formatting Input Data When Training Neural Network in Mathematica

I'm trying to train the following structure of neural networknet with customized loss functionlossnet each code and structure ...
10
votes
0answers
118 views

How to implement graph neural networks in Mathematica?

Graph neural networks are useful for prediction tasks like predicting walks. In python I use DeepGraph typically, but I'm wondering what can be done in the new Version 12. Here's a nice introduction ...
6
votes
1answer
82 views

Neural network layer for vector normalization

We have a neural network that returns a vector $v$ with length $n$. However, these results $v_i$ must be normalized to unity so that their sum $\sum_{i=1} ^{n} v_i=1$. It must be done inside the ...
3
votes
1answer
61 views

One-hot vectors encoding with NetEncoder

I have a text and vocabulary (text has two "the" entries): ...
5
votes
1answer
112 views

Built-in way to draw LinearLayer graph

Newer versions of Mathematica come with built-in tooling for training and simulating neural networks. For a simple LinearLayer, e.g. ...
13
votes
4answers
624 views

Neural network illustrations

(Since this post was met with a certain reluctance to be given answers, a version of it is also posted in Community.) Please share neural networks diagrams you have made in Mathematica / WL. Here is ...
0
votes
0answers
56 views

Dataset format for Neural Networks

I don't think I'm understanding the association form for data to neural networks. I wrote the following network which takes arrays of size (2, 100) as input, and outputs a length 100 vector. I thought ...
5
votes
0answers
130 views

NetTrain on a UNet with a NVidia Quadro P5200 GPU

I am trying to train a UNet on my laptop (Lenovo P72) and I obtain the following error when I use NetTrain on it: CompiledFunction::cfta: Argument {Mean[LibraryFunctionError[LIBRARY_FUNCTION_ERROR,...
0
votes
1answer
77 views

Inferred inconsistent value for dimensions “loss”

I'm trying to write my first neural network in Mathematica: a simple autoencoder. The network takes as input an array of size (2, 100) and reconstructs a vector of length 100 (see below). I'm trying ...
6
votes
1answer
96 views

Compute neural network loss over sliding windows?

I am trying to use the structural similarity index, which is defined in terms of a computation over sliding windows, as a neural network loss function. Obviously one can get a sliding mean using a <...
2
votes
0answers
55 views

Improving the accuracy of the bounding box detection of TextRecognize

My problem concerns the text position detection in a scan. My goal is to find the bounding boxes of the text. ...
7
votes
0answers
474 views

Train your own CycleGAN style translator

I have a set of images (a few hundred) that represent a certain style and I would like to train an unpaired image to image translator with CycleGAN. I'm looking for a tutorial on how one would do ...
19
votes
5answers
2k views

Recurrent neural network in 11.1 explicit examples?

I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
0
votes
0answers
32 views

Unable to replicate Predict/NeuralNetwork example from Help Pages

I am trying to replicate an example right out of the help manual (ref/method/NeuralNetwork). This example compares the convolutional NN versus a fully-connected NN....
-1
votes
1answer
102 views

Neural network to classify gender from username

Does anyone know of a trained net that can classify gender from username from any website? It would be nice if there is something in Wolfram Neural Net Repository or something that can be easily ...
0
votes
1answer
69 views

AttentionLayer what is it and why would it be used

Could anyone elaborate on the new Neural Network layer in Mathematica Verison 12: https://reference.wolfram.com/language/ref/AttentionLayer.html AttentionLayer The documentation is rather sparse on ...
6
votes
1answer
206 views

Symbolic Neural Networks in Mathematica

Mathematica is very well known about its symbolic capabilities/functionality. Heavy users usually say that “everything is a symbolic expression”. Does this principle apply to neural networks? If not, ...
1
vote
1answer
86 views

Random sampling of a discrete distribution in NetGraph

Within a NetGraph I would like to use the output of a softmax layer, interpreted as a probability distribution, to sample a "next token". Since this is done inside an RNN structure, I cannot do this ...
8
votes
1answer
192 views

Is Mathematica's implementation of convolutional neural networks really inefficient?

I'm surprised how slow ConvolutionLayer works with TargetDevice->"CPU". For instance this code: ...
10
votes
1answer
401 views

Bug in Mathematica 12 neural networks?

I recently downloaded Mathematica 12, and I'm experiencing a curious failure in neural networks that had earlier worked. This failure I will demonstrate with the NN in "Classifying Data with Neural ...
3
votes
1answer
105 views

How do I create my own activation function in NetChain in Mathematica?

I want to have my own activation function, say a quadratic function, instead of Tanh, or Sigmoid etc. in Mathematica. How do I insert it in NetChain? e.g., how will the below code look for a new ...
5
votes
0answers
73 views

Can I extract symbolic expression of neural network loss function?

Once we create a neural network with NetChain in Mathematica, can we extract the loss function in the symbolic form for Mathematica to play with symbolic manipulations using Mathematica's built-in ...
0
votes
0answers
65 views

TargetDevice->“GPU” takes no effect in prediction of Classify and ClassifierMeasurements?

I can train the model with GPU via method->"NeuralNetwork" in Classify. I'm on Mathematica 12.0 and the problem also happens in 11.3. Is this a bug since 11.1 to 12.0? In training, GPU is faster ...
5
votes
0answers
98 views

How to extend ImageCases?

I was very excited to see ImageCases being documented in version 12. But I immediately desired a mechanism for adding more entities to ...
3
votes
1answer
143 views

CUDAQ crashes the kernel

Bug introduced in 11.2 and fixed in 12.0.0 It appears that the following code will crash Mathematica kernel: LinearLayer[5] Needs["CUDALink`"] CUDAQ[] I'm using ...
1
vote
1answer
82 views

Problem of result of TopProbabilities in NetModel

Bug introduced in 11.3 and fixed in 12.0.0 I'm on Mathematica 11.3, Classify model could use TopProbabilities without designating an integer. ...
1
vote
0answers
41 views

Use of Normal with layers and plots

In documentation of ConstantPlusLayer we find ...
6
votes
1answer
137 views
6
votes
1answer
158 views

How to load trained RNN in MXNet?

No problems with CNN ...
0
votes
0answers
51 views

Compatibility Nvidia and Mathematica 11.3 [duplicate]

I am wondering about the compatibility between Mathematica 11.3 (Windows or Linux) and the Nvidia Quadro P5200 provided in the ThinkPad P72. Can I be sure that Mathematica will be able to detect and ...
2
votes
1answer
70 views

How can I have two neural network layers act as the input to one layer?

When using NetGraph[], I am try to specify the connections between 3 layers like so: NetGraph[{...some layers...},{...{2,3}->4}] But I receive the following ...
2
votes
1answer
82 views

3D Deconvolutional Layer

I noticed that one of the mxnet APIs (Gluon) includes a 3D Deconvolutional Layer. However, mathematica currently only allows up to 2D deconvolutional layers (see here). Can one somehow implement a 3D ...
2
votes
1answer
58 views

Where to find information about models, data and labels used by Image/AudioIdentify?

I am thinking about using Mathematica 12's ImageIdentify and AudioIdentify functions for an interdisciplinary research project. The social science part of it requires to describe a little bit the ...
0
votes
1answer
225 views

NetGraph/Model for BERT?

Does anyone know of a way to get the BERT model working for word embeddings in Mathematica? Doesn’t seem to be available on GitHub or the Wolfram Net Repo...
1
vote
0answers
26 views

Is there an inverse type function to SequenceLastLayer[]?

I am working on a text based autoencoder, and was happy to see I can feed a variable length text sequence into my network and use SequenceLastLayer[] after a GatedRecurrentLayer[] to only get the ...
1
vote
0answers
65 views

Is Wolfram Cloud going to support GPU training? [duplicate]

Is Wolfram Cloud going to support GPU training? Is there any other possibility for training a neural net (in WL) on a cloud like AWS, Floydhub, or so? I think this concerns lots of people.
0
votes
1answer
112 views

Robust face detection

FindFaces doesn't work when people are far away from the camera. I'm looking for a single accurate method of detecting one or more people in an images, at all ...
1
vote
0answers
68 views

Neural Network stick in an unlearned state

Background: I want to apply a net to mapping from xyY color space to Munsell. The mapping in freely downloadable as a 5000+ entries table. I transformed the table data so that the Munsell Hue is given ...
0
votes
0answers
72 views

Learning weights during training

Let's assume I have a net so the loss function is composed from 3 components: $C_1, C_2, C_3$, and each component is multiply by its weight $(w1, w2, w3)$. The weights should be a function of $\beta$,...
4
votes
0answers
136 views

Visualizing and Understanding CNN with Mathematica

The famous 2013 paper from Zeiler and Fergus "Visualizing and Understanding Convolutional Networks" proposes a method to understand the behavior of CNN using one (or more) DeConv networks coupled with ...
3
votes
1answer
104 views

NetPortGradient returns “floating-point overflow” for this simple network

Consider this simple network that computes the following function: $$ \left\{ \begin{matrix} xy & \mbox{if} \;x,y>0 \\ 0 & \mbox{otherwise} \end{matrix} \right.$$ The net looks like: <...
51
votes
5answers
8k views

Mathematica command that allows it to read my intentions

In version 2.0 of Mathematica there was a command, ReadProgrammerIntentions[ ] which allowed it rapidly compose code that could solve problems simple to complex, ...
3
votes
2answers
310 views

Answer multiple choice questions

FindTextualAnswer isn't working for me here: ...
0
votes
0answers
23 views
5
votes
1answer
242 views

Creating a generator function for a large data set for a neural network

After reading documentation on Training on Large Data Sets, I am still at a loss on how to create a generator function, to read a batch of 1000 of this ...
4
votes
1answer
124 views

How to improve spelling in the Deep Speech NetModel?

There is only one NetModel for speech recognition. As is stated in the network repository, models trained with CTC loss have difficulties in producing correct spelling: ...
2
votes
1answer
29 views

Can I get the “Image Size”, etc. from a NetEncoder in an existing net from the Repository?

I want to get the details about the input used to train a net in the Net Repository, in my case "LeNet Trained on MNIST Data". I can get its decoder by: ...