Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
2
votes
0answers
79 views

Specifying feature types for BayesianMinimization

I'd like to use Bayesian optimization over a pair of features, one nominal, one numerical. If I do something like this: ...
5
votes
0answers
122 views

What's BayesianMinimization and related functions based on?

Is it specified anywhere what the backend is for the Bayesian optimization related functionality in Mathematica v11? I'm specifically referring to the Bayesian* ...
10
votes
3answers
617 views

Approximation with radial basis functions

I want to approximate some functions with basisfunctions, which can be easy Fourier-transformed. So I got the idea to approximate my function with Gaussian normal-distribution curves. This led me to ...
2
votes
1answer
141 views

Can Predict return non-numerical values?

I just started working with the Mathematica machine learning package. When I use Predict, I can predict only numerical values like ...
2
votes
0answers
46 views

How to add sugar for NetEncoder?

I'm tired of the extra level of list in NetEncoder and would like to get rid of it. The obvious thing fails: ...
2
votes
1answer
120 views

Neural network giving different answers

I'm very new to machine learning and pretty new to Mathematica, trying to implement a simple neural network that acts as a "XOR" gate. Here's my code: ...
6
votes
1answer
4k views

How to train Sequence-to-sequence autoencoder using LSTM?

According Keras blog,I find the Seq2Seq auto-encoder. But it didn't give any example only code. To build a LSTM-based autoencoder, first use a LSTM encoder to turn your input sequences into a ...
3
votes
1answer
256 views

Machine learning classify function with audio and set of pictures

As I see from documentation, Classify function supports Audio and Pictures as input, video is not supported unfortunately :( Will it work if I try to use classify for mixed data input like ...
4
votes
1answer
266 views

Weighted Data within Classify and Predict (or NetTrain)

I posed this on Wolfram Community about a week ago and no one there seems to have a good solution, so I will try it here. (It may well be that this is an issue for Mathematica developers and that ...
1
vote
0answers
40 views

Dynamically adjusting BatchSize during training of NetChain

Is it possible to dynamically adjust BatchSize during NetTrain training session? For instance, can I create a schedule to adjust BatchSize based on the training round? -CJ
1
vote
0answers
71 views

.wlnet file is not available now?

After I run this code in Mathematica 11.2 net = NetModel["LeNet Trained on MNIST Data"]; Export["digital.wlnet", net] Then I try to import it with this code As ...
1
vote
0answers
71 views

Removing ResourceObject and other resources downloaded from Wolfram servers/

What happens with recourses downloaded from Wolfram Servers? I have recently been playing with their neural net library, until I noticed that each model is takes up a lot of space. How do delete ...
2
votes
1answer
238 views

How do you allow sequence outputs in recurrent layers?

I'd like to train this reverse-uppercase sample data: ...
1
vote
1answer
330 views

Mathematica Machine Learning (Method “NeuralNetwork”)

I am trying to use Predict and Classify functions. I am interested what NetworkDepth really ...
11
votes
2answers
251 views

Export BatchNormalizationLayer as MXNet

Bug introduced in 11.2 and remains in 12.0.0 I just tried to import a net from mathemtica into pythons using MXNet. It works fine with the following manual. However, as soon as I try to add a ...
6
votes
1answer
327 views

How to solve the xor problem with neural network

As this playground show after you click this button, just four levels can solve the xor problem. So I try to simulate it in Mathematica Generate test points ...
1
vote
0answers
145 views

How to train a network using out of core training when data have different length?

I posted How to use Mathematica to train a network Using out of core classification? some month ago. The network receive some fixed-length input and produce another fixed-length output,this is How to ...
8
votes
2answers
276 views

Can't import Gluon into mma

This is a simple DNN from Fast, portable neural networks with Gluon HybridBlocks: This is json file and params file of Gluon(MXNet) ...
3
votes
1answer
241 views

Colorizing greyscale images?

I'm looking for a trained colorization model (wlnet file) that is available to download and immediate use in 11.2. Checking the 21 currently existing NetModels: ...
3
votes
1answer
214 views

Why the GPU will cost more time when train the net

I'm in Windows 10 $Version 11.2.0 for Microsoft Windows (64-bit) (September 11, 2017) ...
3
votes
1answer
198 views

How to reserve the Training Progress Panel after training

After the network train, the Training Progress Panel will disappear in MMA.But the panel always give a lot of information about the trained result. Such as this net ...
2
votes
1answer
76 views

How to ensure the iteration will converge when train the NetWork

Let's generate some points for test ...
1
vote
0answers
119 views

How to find all number in a image by neural-networks method

I have a big complaint about function TextRecognize. Alexey Popkov have verified here. Actually it can do it as the attribute ...
3
votes
0answers
507 views

Why “Inception V3 Trained on ImageNet Competition Data” have 1001 outputs?

There are 6 pre-trained models on ImageNet in NetModel. ...
3
votes
2answers
214 views

CloudDeploy neural network unknown error

I tried to use CloudDeploy to put my nicely trained network into the cloud for other people to use. However, after calling the following: ...
11
votes
1answer
612 views

How to use an external GPU to train neural networks in Mathematica?

Taking steps in the uncharted territories of eGPUs, I have installed an NVIDIA GeForce Titan Xp GPU on an eGPU enclosure (Mantiz MZ-02) and have connected it to my laptop (HP Spectre x360 - 15-bl075nr ...
19
votes
0answers
601 views

How to ImageRestyle high-res images?

I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels. All the examples in the documentation use images around 500 x 500 or ...
6
votes
1answer
366 views

Why I can only train some NetModel with GPU

I can train NetModel's models with CPU. I'm on Windows 10 with Mathematica 11.2 GPU is GTX1080 with 8G memory. My datasets is 1000 pictures with 224*224. I can train some NetModel like ...
5
votes
1answer
229 views

Error Import a MXNet model Export by Mathematica in 11.2 and 11.3

the model was trained by net = NetModel["Inception V1 Trained on ImageNet Competition Data"] ...
3
votes
1answer
139 views

CUDAQ crashes the kernel

Bug introduced in 11.2 and fixed in 12.0.0 It appears that the following code will crash Mathematica kernel: LinearLayer[5] Needs["CUDALink`"] CUDAQ[] I'm using ...
3
votes
1answer
355 views

ImageRestyle not working in docs?

ImageRestyle[] seems like a cool new function in v11.2, but is there something I need to to get this to work: I have a MacBook Pro (Retina, 15-inch, Late 2013) ...
2
votes
0answers
690 views

Stochastic Gradient Descent with constraints

Let's say we have a convex objective function $f(\textbf{x})$, with $\textbf{x}\in R^n$ which we want to minimise under a set of constraints. The problem is that calculating $f$ exactly is not ...
4
votes
0answers
178 views

NetTrain throws internal error with large images as input (GPU)

I am training a convolutional Network with a dataset consisting of Images of the same size on my GPU (200x100 pixels, GTX 1080Ti). The images are previously resized with ...
9
votes
3answers
726 views

Example of NetChain running in MXNet cause Error

Cross post here Problem remains in Mathematica 11.2 First defining the net ...
2
votes
1answer
299 views

Save trained NetChain between Mathematica sessions?

Let's say I have written a NetChain machine learning setup, trained the chain with NetTrain and obtained a model ready to ...
0
votes
1answer
101 views

generator didn't return a correct type in NetGraph with Multi-port

In this example,generator[<|"BatchSize" -> 4|>] get an association of lists, but NetTrain[net, generator] can't be used....
5
votes
1answer
927 views

How to make a switch in Neural Networks?

In this paper,they design a network like this. The left(green) is a normal network that mapping one feature to another feature,the right(red) side is an autoencoder(using RNN).But a switch is ...
8
votes
1answer
305 views

Can we implement a Neural Network interactively?

Implementing a Neural Network manually need some code and need to make some connections between these components. Can we implementing a Neural Network interactively?If I want to make a net like ...
2
votes
2answers
403 views

How to get the loss function used in NetTrain?

When the third argument to NetTrain is set to Automatic, how can you tell what loss function it actually used and extract it? ...
19
votes
5answers
2k views

Recurrent neural network in 11.1 explicit examples?

I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
4
votes
0answers
99 views

Transfer Learning: How to take certain layers from a pre-trained neural net, add it to a new net, and keep its variables fixed? [duplicate]

How can one copy specified layers from a pre-trained neural network and add them to another trained neural net? For instance, ...
4
votes
0answers
159 views

NetTrain with External GPU?

I'd like to use the new Neural Networks functionalities in v11 on my Macbook Pro, unfortunately, most macs do not have the supported Nvidia cards. However, there is the option for using an external E-...
5
votes
1answer
665 views

Is it possible to fix the weight of a certain layer during neural network training?

As suggested by the title, is it possible to fix some part of the neural network while training? Since Mathematica provides a way to extract part of a neural network and combine it with some layers ...
4
votes
1answer
114 views

Accuracy during training?

Is there any way to see a plot of the accuracy over the Validation set for each round instead of the loss graph, during a NetTrain session? There probably is and I'm just missing it...
8
votes
1answer
408 views

NetTrain automatic settings

I'm trying to compare Mathematica's NetTrain with other algorithms, and I used Automatic settings as they were working quite ...
8
votes
1answer
438 views

How to adjust a image as the empty image

As Vitaliy Kaurov's answer mentioned, anyone can use a method based on Neural Network (NN) to give a try? Then the bounty is deserved. Suppose I have a empty paper like Then I write some text on the ...
8
votes
1answer
501 views

Batching in inference and support for multiple GPUs

I know that Mathematica supports GPU inference, and can be told which GPU to run models on by specifying TargetDevice->{"GPU",2} or such. My questions are as follows: 1) By using the above statement ...
5
votes
1answer
165 views

Can `DropoutLayer` drop complete channels of a tensor?

DropoutLayer randomly deactivates a fixed fraction of the outputs of the layer before. My understanding of dropout regularization is that instead of training a ...
4
votes
1answer
502 views

Joint Training and multiple losses in NetTrain

Jointly training a neural network to solve multiple tasks simultaneously sometimes results in elevated accuracy, and I'm looking for any known examples of this in Mathematica. Here's the specific ...
1
vote
1answer
156 views

Need advice for approach for multivariate regression/prediction using Deep Networks

I am trying to build predictive models for 2 outputs given approximately 10 input variables. I understand that I would first look at the simplest model, such as a multivariate linear regression, ...