The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
4
votes
2answers
169 views

How to add MeanSquaredLossLayer to my network

I would like to choose my loss function. From the references for MeanSquaredLossLayer, I can add it to NetChain, ...
3
votes
1answer
236 views

Extrapolate data from Predict function

I'm trying to predict the next Close value in the S&P500 index using the following code: ...
6
votes
1answer
383 views

Neural Networks: Modifiying NN structures?

From this nice answer one can import pretrained NN models and structures for state of art models. ...
2
votes
1answer
172 views

NetTrain ClassifierFunction/NetChain Entropy

Obtain a trained network from NetTrain as net = NetTrain[net, dat]; which i believe returns a ClassifierFunction (although Head[net] returns NetChain). In ...
3
votes
1answer
399 views

Progress bar explanation NetTrain

I was wondering what the progress window that appears when I call NetTrain is trying to tell me. There are 7 values given and one graph: round batch inputs/second (...
8
votes
1answer
615 views

Which GPUs does NetTrain work with?

NetTrain's option TargetDevice -> "GPU" works for old macbooks that have GEForce GT 750m cards (like mine), but what about other nvidia cards? Does it (or will ...
7
votes
1answer
177 views

Dot product of two tensors within neural network NetGraph

I would like to train a word-embedding type model (specifically "Walklets" from the paper by Bryan Perozzi et al). In the simplest form (ignoring stuff like negative sampling), we want to maximize $\...
4
votes
1answer
362 views

Extract training and test set performance from a neural net

I would like to extract a graph of the history of a neural net's performance, as it is trained. This is so I can compare it with the equivalent from Tensorflow (for some reason an equivalent network ...
2
votes
0answers
197 views

Binary Image Classification using convolutional layer

I have a sample of images of chairs and tables and I want to use a neural network using convolutional layer and gpu-acceleration for training. This is what I have so far - how do I train the network? ...
2
votes
0answers
118 views

Are there any examples of wlnets?

I'm looking for some examples of the new neural network file format (.wlnet) introduced in v11. Has anyone made or found any available ones, to import and use?
28
votes
4answers
1k views

Neural Networks: Does Mathematica (v11) experimental code support state-of-art Models?

Mathematica made a big step implementing Neural Networks. I checked some examples for deep learning (ChainNet), also the related link. I see that model structures such as LaNet can be developed. ...
11
votes
0answers
492 views

How to speed up calculations on big symbolic matrices?

this is my first time posting something on a community of the StackExchange platform, so please feel free to correct me if I'm doing something wrong. :) Additionally you should probably know that I'm ...
7
votes
1answer
699 views

Use autoencoder for dimensionality reduction

I have been trying to follow this tutorial (https://www.wolfram.com/language/11/neural-networks/unsupervised-learning-with-autoencoders.html?product=mathematica) to train an autoencoder in Mathematica,...
11
votes
1answer
270 views

Apply Result of NetTrain using GPU?

I'v trained a deep network (e.g. LeNet) using NetTrain with TargetDevice -> "GPU". Everything works well and it is really fast. But now I have a trained network and tens of thousands of samples to ...
3
votes
0answers
170 views

Resources to learn about Neural Nets using Mathematica?

I'm interested in learning about Neural Nets and I'd really like my instruction to be in Mathematica if possible. For instance, a tutorial like this one: http://neuralnetworksanddeeplearning.com/...
9
votes
1answer
255 views

How can I train a neural net to decide the 3rd digit of a number?

As a "toy problem" to explore the new neural net library, I wanted to train a neural net with: Input: 1 real number in the range [0, 1) Output: the nth digit (i.e. one of {0, 1, 2, 3, 4, 5, 6, 7, 8, ...
7
votes
2answers
511 views

Staged training of Neural Networks

From what the documentation says about NetTrain and NetInitialize and what the progress indicator shows when reevaluating ...
11
votes
1answer
266 views

How can I train a neural net with multiple categorical inputs?

I think I understand how to create a neural net that has multiple categorical inputs, but I don't seem to be able to invoke NetTrain successfully on it. As a ...
8
votes
2answers
618 views

Training data generator?

Python has generators which save memory, is there a technique for generating in memory examples for your training set "on the fly". For example purposes, I constructed here a regressor for blur: <...
9
votes
1answer
586 views

Can someone explain how the dilation in the ConvolutionalLayer works?

ConvolutionalLayer has a few optional parameters. "Dilation" is one I'm having trouble understanding how it works and the documentation is terse. Can anyone give some explanation? References: https:...
45
votes
2answers
2k views

Generalized Backpropagation for Neural Networks (e.g. DeepDream)

Is there currently any way to abuse NetTrain to maximize an arbitrary cost/utility -function in some hidden layer and/or even modify the input to increase neuron ...
7
votes
1answer
442 views

NetEncoders vs MXNet preprocessing

According to this great answer, the MXNet framework powers Mathematica's new neural net functions. So I wanted to check and make sure the results agree for a pretrained network (available here: https:/...
5
votes
1answer
246 views

Updated: Correct Formatting of Dataset (labeled columns and rows) for Predict v NetTrain?

Problem I can not seem to figure out the correct way of formatting Dataset to be used with predict. I am providing Mathematica's example, which works fine. I also am including an abitrary "dataset" ...
7
votes
1answer
316 views

Memory leak in NetTrain?

Issue NetTrain seems to leak memory. Example We define a simple NetChain: ...
34
votes
1answer
3k views

RNN in Mathematica?

Recurrent neural network is an important part of machine learning and its improved version: LSTM network is widely applied, but Mathematica seemingly is in lack of these two features and in my opinion,...
70
votes
6answers
4k views

Q&A Mathematica v.11 Neural Networks: A comprehensive look at Layers, Net Functions, and pioneering into this [[experimental]] code

Motivation As Mathematica v.11 was released earlier this month with a host of new [[experimental]] functions and a limited number of examples on curated data that ...
11
votes
1answer
854 views

A comprehensive list of all correct input formats for [[experimental]] Neural Net functions?

Question: correct formats for Mathematica's NetTrain function Explanation of the problem Background So Mathematica 11 was released earlier this month, and while there are many improvements and they ...
30
votes
2answers
3k views

Using a Convolutional Neural Network for time series classification

In the recent new in Mathematica 11 webinar one user asked during the Q&A session wether the current implementation of neural networks in Mathematica 11 could be used for processing time series. ...
8
votes
0answers
340 views

Use of new machine learning capability for search problems (reinforcement learning)

I work with search algorithms, often of an adversarial nature, and want to understand how to apply Mathematica's machine learning capabilities, especially those new in version 11, to this type of ...
10
votes
1answer
126 views

Bug when importing Neural Nets from .m files in a fresh kernel

Bug introduced in 11.0.0 and fixed in 11.0.1 Importing Neural Nets from .m files seems to destroy the neural net. ...
8
votes
1answer
376 views

Neural net example not working

Bug introduced in 11.0.0 and fixed via paclet update The Wolfram Mathematica site provides this example. I have copied and pasted into a notebook. The resource is reached and correctly sampled. ...
25
votes
1answer
1k views

How to monitor the process of Neural Network Learning

Main Problem I'm exploring the neural network in v11 and I would like to monitor the training progress in my own way instead of Mathematica's default way. So my question is, how to do this ...
42
votes
3answers
5k views

How do you make a Neural Net?

In the new Mathematica release (v11), NeuralNetworks is one of the new main features. However, the documentation isn't that clear on what function should be used in ...
6
votes
1answer
2k views

Parsing a caffe prototxt file?

Caffe has its own visualization tools, for instance you and draw all the layers in a network easily like so: But I wanted to analyze a network structure myself in mathematica, so I started to write a ...
12
votes
0answers
904 views

Neural network playground [closed]

I came across this Neural Net Playground demonstration based on Google's Tensorflow package. It visualizes the data processing inside a neural network and allows you to tweak parameters and ...
13
votes
1answer
1k views

How do I configure the input and output layers of a neural network?

I'm confused about how to set some of the basic properties of a neural network structure using Classify. I'm trying to set the basic properties of a simple neural ...
13
votes
1answer
1k views

Is there any decent deep learning library in Mathematica?

Deep Learning is the currently trending method in machine learning community. Some languages like python and matlab have some very convenient toolbox for deep learning. So is there any decent deep ...
4
votes
1answer
193 views

Setting MaxIterations for neural network function `Predict`?

The neural network implementation of Predict seems to support a number of undocumented options as shown in a previous question: How to change NeuralNetwork options?....
11
votes
1answer
928 views

Neural Networks in Predict function

I'm trying to reproduce the result giving by a Predict function with a Neural Network as the chosen method. So, I'm training from this set: ...
3
votes
0answers
75 views

Undo automatic update [closed]

I was working with Predict function (with a neural network and today, and when I executed the same notebook I have been working for some time, Machine Learning package was automatically updated (it ...
13
votes
2answers
2k views

How to train a convolutional neural net on images?

The functions Predict[] and Classify[] both have the option Method -> "NeuralNetwork", ...
11
votes
1answer
309 views

How to view ClassifierFunction's preprocessed data?

Classify apparently preprocesses your input data, for example (same example from Classify reference page, but using ...
13
votes
2answers
1k views

How to change NeuralNetwork options?

How can I manipulate the architecture and problems of a NeuralNetwork in Predict or Classify? For example, running the following ...
33
votes
1answer
1k views

How can I export my learned ClassiferFunction[] and PredictorFunction[]s?

Mathematica 10 provides beautiful high-level machine learning functionality. Sadly, the learned functions once created are rather opaque objects. I need to use them in other projects, so here is my ...
0
votes
1answer
89 views

What's going wrong with this button! [duplicate]

I'm implementing an Adaline algorithm where all inputs are 1x5526 and the output is a number from 1 to 10. I have this two functions defined and worked outside the ...
4
votes
1answer
195 views

Debugging the context of a Package

I am working on a package of functions that complement the NeuralNetworks` package that Wolfram provides. I am having a problem with the following code, which is ...
2
votes
0answers
321 views

How to predict some constant number of values with NeuralNetworks

Example: << NeuralNetworks` data = {Sin[#]} & /@ Range[0, 4 Pi, 0.5]; learn = data[[1 ;; 15]]; Now, lets fit our neural network: ...
17
votes
1answer
2k views

Reference request for neural network programming in Mathematica

I'm looking for a good reference/book on programming neural networks in mathematica. I've been working through Freeman's "Simulating Neural Networks with Mathematica," but it is from 1994 so is quite ...