All Questions
Tagged with machine-learning neural-networks
300 questions
3
votes
1
answer
285
views
Colorizing greyscale images?
I'm looking for a trained colorization model (wlnet file) that is available to download and immediate use in 11.2. Checking the 21 currently existing NetModels:
...
- 31.8k
3
votes
0
answers
748
views
Why "Inception V3 Trained on ImageNet Competition Data" have 1001 outputs?
There are 6 pre-trained models on ImageNet in NetModel.
...
- 6,866
11
votes
1
answer
870
views
How to use an external GPU to train neural networks in Mathematica?
Taking steps in the uncharted territories of eGPUs, I have installed an NVIDIA GeForce Titan Xp GPU on an eGPU enclosure (Mantiz MZ-02) and have connected it to my laptop (HP Spectre x360 - 15-bl075nr ...
- 1,883
23
votes
1
answer
943
views
How to ImageRestyle high-res images?
I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels.
All the examples in the documentation use images around 500 x 500 or ...
- 31.8k
2
votes
0
answers
1k
views
Stochastic Gradient Descent with constraints
Let's say we have a convex objective function $f(\textbf{x})$, with $\textbf{x}\in R^n$ which we want to minimise under a set of constraints. The problem is that calculating $f$ exactly is not ...
- 841
9
votes
3
answers
936
views
Example of NetChain running in MXNet cause Error
Cross post here
Problem remains in Mathematica 11.2
First defining the net
...
- 6,866
2
votes
1
answer
492
views
Save trained NetChain between Mathematica sessions?
Let's say I have written a NetChain machine learning setup, trained the chain with NetTrain and obtained a model ready to ...
- 12.1k
0
votes
1
answer
137
views
generator didn't return a correct type in NetGraph with Multi-port
In this example,generator[<|"BatchSize" -> 4|>] get an association of lists, but NetTrain[net, generator] can't be used....
- 6,866
6
votes
1
answer
2k
views
How to make a switch in Neural Networks?
In this paper,they design a network like this.
The left(green) is a normal network that mapping one feature to another feature,the right(red) side is an autoencoder(using RNN).But a switch is ...
- 6,866
10
votes
1
answer
480
views
Can we implement a Neural Network interactively?
Implementing a Neural Network manually need some code and need to make some connections between these components.
Can we implementing a Neural Network interactively?If I want to make a net like ...
- 6,866
22
votes
5
answers
4k
views
Recurrent neural network in 11.1 explicit examples?
I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
- 12.1k
4
votes
0
answers
126
views
Transfer Learning: How to take certain layers from a pre-trained neural net, add it to a new net, and keep its variables fixed? [duplicate]
How can one copy specified layers from a pre-trained neural network and add them to another trained neural net?
For instance,
...
- 1,883
4
votes
0
answers
203
views
NetTrain with External GPU?
I'd like to use the new Neural Networks functionalities in v11 on my Macbook Pro, unfortunately, most macs do not have the supported Nvidia cards. However, there is the option for using an external E-...
- 31.8k
6
votes
1
answer
1k
views
Is it possible to fix the weight of a certain layer during neural network training?
As suggested by the title, is it possible to fix some part of the neural network while training?
Since Mathematica provides a way to extract part of a neural network and combine it with some layers ...
- 269
4
votes
1
answer
206
views
Accuracy during training?
Is there any way to see a plot of the accuracy over the Validation set for each round instead of the loss graph, during a NetTrain session?
There probably is and I'm just missing it...
- 3,820
8
votes
1
answer
739
views
NetTrain automatic settings
I'm trying to compare Mathematica's NetTrain with other algorithms, and I used Automatic settings as they were working quite ...
- 999
8
votes
1
answer
656
views
Batching in inference and support for multiple GPUs
I know that Mathematica supports GPU inference, and can be told which GPU to run models on by specifying TargetDevice->{"GPU",2} or such.
My questions are as follows:
1) By using the above statement ...
- 278
4
votes
1
answer
833
views
Joint Training and multiple losses in NetTrain
Jointly training a neural network to solve multiple tasks simultaneously sometimes results in elevated accuracy, and I'm looking for any known examples of this in Mathematica.
Here's the specific ...
- 31.8k
1
vote
1
answer
284
views
Need advice for approach for multivariate regression/prediction using Deep Networks
I am trying to build predictive models for 2 outputs given approximately 10 input variables.
I understand that I would first look at the simplest model, such as a multivariate linear regression, ...
- 459
4
votes
2
answers
439
views
Regarding input to NetTrain function
Essentially I have used the SemanticImport[] function on a csv file with headers for each column. Now I understand that each of these headers is referred to 'key' in mathematica. *
I have no problem ...
- 459
2
votes
1
answer
537
views
Problem initializing training set on recurrent net
I would like to train a time-series data using GatedRecurrentLayer. The data consists of k scalar features mapping to a scalar number at every time step: i.e.
...
- 21
11
votes
3
answers
994
views
Using Mathematica wlnet model in C++
Suppose if there is a trained net:
SeedRandom[1234];
net = NetInitialize@NetChain[{5, 3}, "Input" -> 2];
It can predict image in mma:
...
- 6,866
3
votes
1
answer
159
views
1
vote
0
answers
233
views
NetTrain always crashes in out of core training with NetEncoder Setting
See this official example example
My enviroment is Windows 10 GTX1080 with Mathematica 11.1.1
It's Ok if I import all training images into memory.
Even in the simple case...
- 8,649
11
votes
2
answers
703
views
How to combine Neural Network and Audio like Classify?
I want to combine Audio object and Neural Network ,first thing I remember is Classify
...
- 6,866
8
votes
1
answer
209
views
How to extract of sub-net of NetGraph correctly?
net = NetGraph[{3, 5, 8}, {1 -> 2 -> 3}, "Input" -> 2]
Take[net, {1, 2}]
But ...
- 6,866
5
votes
2
answers
287
views
How to make similar objects have similar embedding weights?
In the read world, there are many many phones(aa ae ah ao ar aw ax ay b ch d dh ...).
But for brief,I only use three phones(aa ah ae) to illustrate my question.And it only need training Data,no Test ...
- 6,866
3
votes
0
answers
123
views
How can I monitor the process of neutral network training?
In the Linux command line,type wolfram then use NetTrain[net, mnist, Automatic, "LossEvolutionPlot"] can get the ...
- 6,866
3
votes
1
answer
107
views
Similar data,same net,different level of MSE loss?
Using same net and similar data,but MSE loss is very different.
This is the original data,and it can not learn very well.
...
- 6,866
12
votes
3
answers
775
views
How to make Advanced Activations Layers in Mathematica?
I want to try Advanced Activations Layers in Mathematica,but not found.
So I try to use ElementwiseLayer to implement it.
...
- 6,866
10
votes
1
answer
372
views
How does mathematica compute loss with multi-losses?
I want to make a DNN that it can learn from text feature(1534-dims) and old audio features(256*4(four old frames)-dims) to predict audio feature(256-dims) at current frame.
So it has two inputs,one ...
- 6,866
13
votes
2
answers
524
views
Simple example of NetGraph running in MXNet?
There is an great example of exporting a NetGraph (that was trained in Mathematica) into the MXNet's format.
However, I think there's a bug or something is wrong with the answer, because once ...
- 3,820
15
votes
1
answer
509
views
Using PredictorMeasurements with a neural net?
PredictorMeasurements doesn't work with NetGraph, here's an example:
...
- 3,820
21
votes
1
answer
2k
views
How to import a Tensorflow model?
I've trained a network in Tensorflow and have the checkpoint files, I'd like to if anyone has written a parser or importer to pull the evaluation graph and/or weights into Mathematica?
- 3,820
2
votes
1
answer
613
views
4
votes
1
answer
588
views
How to use Multi-Inputs in NetGraph with NetTrain?
I want to train a network,the first input is a Integer,the second input is 10-dims vector.
Assume we have those data：
...
- 6,866
2
votes
1
answer
135
views
How to get low dimension representation of data based on some knowledge?
I want to map the 500-dims unit vectors to 128-dims and it know some knowledge(43-dims).
So I write this code:
...
- 6,866
12
votes
1
answer
974
views
Same neural network gives different results
I was playing with the neural network in Mathematica and found that the same neural network gives different classification results to the same image, which is very strange.
Consider classifying this ...
- 27.8k
5
votes
1
answer
461
views
Response of Dynamic is slow
I wrote the following code to make an interactive GUI for Mathematica's Neural Network example of
Digit Classification
Here is the Code
...
- 77
13
votes
2
answers
1k
views
Implementing a Neural Network
TLDR: I am implementing a neural net in Mathematica and need help with back propagation.
This is purely for the joy of implementing a neural network with a functional programming language. If someone ...
- 357
1
vote
1
answer
81
views
Get a trained net and the training session properties?
In version 11.1 there is an additional signature for NetTrain:
But this only returns the property, how can I get the net and the list of properties I want?
Minimal example code:
...
- 3,820
6
votes
2
answers
4k
views
Neural network: Line detection in Image
I am playing around with Mathematica's new Neural Network toolbox and am trying to teach a network to detect lines in quite noisy images.
An example Input image would look like the following:
The ...
- 1,535
14
votes
1
answer
302
views
WLNet format incompatible between version 11.0 and 11.1
It seems that there are some behavior changes of neural network layers from version 11.0 to 11.1 that leads to the incompatibility of WLNet format.
Consider this example:
Network exported in 11.0
<...
- 27.8k
91
votes
1
answer
14k
views
Crack CAPTCHA using deep learning
Deep convolutional neural networks are very good at computer vision related tasks. Optical Character Recognition (OCR) is one important branch of computer vision. In fact, the convolution neural ...
- 27.8k
9
votes
1
answer
268
views
Adding computer vision datasets?
I find having ResourceData/Objects for machine learning datasets to be extremely useful, with their "TrainingData", "TestData" properties:
Right now there's only a handful:
And even fewer for ...
- 31.8k
14
votes
1
answer
918
views
Neural machine translation model using deep learning
In Mathematica version 11.1, SequenceAttentionLayer is introduced to model attentions in the recurrent neural network. It has been shown that attention mechanism ...
- 27.8k
9
votes
1
answer
152
views
Can Mathematica Neural Net make use of the REC file format for images like MXNet?
When using large set of images for training neural networks (>10000, size 250 x 250 each) the time to read the images is quite long.
My first approach was to use the DataSet functionality of ...
- 131
20
votes
4
answers
1k
views
How to use Mathematica to train a network Using out of core classification?
I see there is doc about how to train a network Using out of core image classification and this question.But the object is only image.
I want to use a binary file as data(Sequence to Sequence case),...
- 6,866
5
votes
1
answer
511
views
How to build a NetChain by the information of ClassifierFunction?
NetChain provides a method NetExtract.
I want to see how standClassify = Classify[trainingData, Method -> "NeuralNetwork"] works,beacause it has a better ...
- 449
5
votes
1
answer
311
views
Using a classification Neural Net and parameter to ClassifierMeasurements[]
I created and trained a simple neural net, which takes some inputs and produces a 3-class classification. Then I feed it to CM[] function with some test data, and... nothing. Haven't been successful ...
- 1,370