Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
45
votes
2answers
7k views

Object detection and localization using neural network

Four important computer vision tasks are classification, localization, object detection and instance segmentation (image taken from cs224d course): These four tasks are all built on top of the deep ...
18
votes
4answers
930 views

How to use Mathematica to train a network Using out of core classification?

I see there is doc about how to train a network Using out of core image classification and this question.But the object is only image. I want to use a binary file as data(Sequence to Sequence case),...
9
votes
3answers
753 views

Example of NetChain running in MXNet cause Error

Cross post here Problem remains in Mathematica 11.2 First defining the net ...
7
votes
3answers
654 views

how to take ImageFeatures?

I want to know how to transform images to feature vector. There is a function FeatureExtractor.And it has some methods. ...
70
votes
6answers
4k views

Q&A Mathematica v.11 Neural Networks: A comprehensive look at Layers, Net Functions, and pioneering into this [[experimental]] code

Motivation As Mathematica v.11 was released earlier this month with a host of new [[experimental]] functions and a limited number of examples on curated data that ...
8
votes
2answers
632 views

Training data generator?

Python has generators which save memory, is there a technique for generating in memory examples for your training set "on the fly". For example purposes, I constructed here a regressor for blur: <...
11
votes
1answer
452 views

Creating an indicator function in a neural network

I am working on implementing the loss function of the Yolo version 2 object detection network and building from the construction notebook in the Wolfram Neural Network repository Yolo Version 2 so I ...
7
votes
1answer
169 views

NetPortGradient output port restriction

The documentation for NetPortGradient says net[<|..., NetPortGradient[oport] -> ograd|>, NetPortGradient[iport]] can ...
2
votes
1answer
76 views

Issue deploying a FormPage using Classify

I developed this code that allows me to recognize what breed is the dog in the inserted image (for the time being developed only for five breeds of dogs), however, when I go to insert the image in ...
7
votes
1answer
372 views

How to delete the parameter of a Neural Network?

Mathematica Neural Networks based on MXNet. And there is lots of model in MXNet(MXNet Model Zoo). For example,I follow a tutorial An introduction to the MXNet API —...
86
votes
1answer
12k views

Crack CAPTCHA using deep learning

Deep convolutional neural networks are very good at computer vision related tasks. Optical Character Recognition (OCR) is one important branch of computer vision. In fact, the convolution neural ...
44
votes
4answers
3k views

Generative Adversarial Network

Generative adversarial networks (GAN) is regarded as one of "the most interesting idea in the last ten years in machine learning" by Yann LeCun. It can be used to generate photo-realistic images that ...
34
votes
1answer
3k views

RNN in Mathematica?

Recurrent neural network is an important part of machine learning and its improved version: LSTM network is widely applied, but Mathematica seemingly is in lack of these two features and in my opinion,...
28
votes
1answer
2k views

How to export an MXNet?

I was hoping there was some way to generate the .params and .json file needed to define an MXNet model, from a network trained using NetTrain[] in Mathematica. I ...
16
votes
1answer
1k views

How to implement a stateful RNN?

If the model is stateless, the cell states are reset at each example. With the stateful model, all the states are propagated to the next example. Stateful RNNs can learn the long sequences. For ...
13
votes
4answers
649 views

Neural network illustrations

(Since this post was met with a certain reluctance to be given answers, a version of it is also posted in Community.) Please share neural networks diagrams you have made in Mathematica / WL. Here is ...
15
votes
1answer
429 views

Training Neural Networks on Cloud GPUs (Wolfram Cloud / AWS / Paperspace /etc)

I have spent a lot of time lately training neural networks. However, my poor laptop has only an AMD GPU, so I am stuck training these networks on the CPU. That means I get to train networks over ...
13
votes
2answers
1k views

How to change NeuralNetwork options?

How can I manipulate the architecture and problems of a NeuralNetwork in Predict or Classify? For example, running the following ...
8
votes
1answer
629 views

Which GPUs does NetTrain work with?

NetTrain's option TargetDevice -> "GPU" works for old macbooks that have GEForce GT 750m cards (like mine), but what about other nvidia cards? Does it (or will ...
13
votes
1answer
1k views

How to visualize attention?

In the articles about sequence attention we can see images like this: Here we see that while translating from French to English, the network attends sequentially to each input state, but sometimes it ...
11
votes
1answer
315 views

How to view ClassifierFunction's preprocessed data?

Classify apparently preprocesses your input data, for example (same example from Classify reference page, but using ...
12
votes
1answer
907 views

Configuring GPU for NetTrain

I currently have access to a system with two GPUs: GeForce GTX 1080 and Tesla K40c I would like to use this machine for training neural networks in Mathematica. When using the option ...
7
votes
1answer
1k views

Fashion segmentation with a neural net?

I would like to train a network that can parse clothing: Does anyone know of a fashion segmentation network with or without pre-trained weights available that I can use in Mathematica? Update: I ...
7
votes
2answers
641 views

TargetDevice->“GPU” fails even though a CUDA GPU exists

Similar question has already been asked, but in that case, the method didn't work due to OpenCL compatibility. I have an older CUDA card. Worked great with CUDALink in Mathematica 8: ...
5
votes
1answer
709 views

Is it possible to fix the weight of a certain layer during neural network training?

As suggested by the title, is it possible to fix some part of the neural network while training? Since Mathematica provides a way to extract part of a neural network and combine it with some layers ...
11
votes
2answers
501 views

How to make Advanced Activations Layers in Mathematica?

I want to try Advanced Activations Layers in Mathematica,but not found. So I try to use ElementwiseLayer to implement it. ...
6
votes
1answer
386 views

Neural Networks: Modifiying NN structures?

From this nice answer one can import pretrained NN models and structures for state of art models. ...
2
votes
1answer
247 views

NetModel fails to load a pre-trained model

Running Mathematica 11.1.1 on windows NetModel["LeNet Trained on MNIST Data"] as per the help page gives $Failed result. ...
46
votes
2answers
2k views

Generalized Backpropagation for Neural Networks (e.g. DeepDream)

Is there currently any way to abuse NetTrain to maximize an arbitrary cost/utility -function in some hidden layer and/or even modify the input to increase neuron ...
28
votes
4answers
1k views

Neural Networks: Does Mathematica (v11) experimental code support state-of-art Models?

Mathematica made a big step implementing Neural Networks. I checked some examples for deep learning (ChainNet), also the related link. I see that model structures such as LaNet can be developed. ...
34
votes
1answer
1k views

How can I export my learned ClassiferFunction[] and PredictorFunction[]s?

Mathematica 10 provides beautiful high-level machine learning functionality. Sadly, the learned functions once created are rather opaque objects. I need to use them in other projects, so here is my ...
13
votes
2answers
3k views

How to train a convolutional neural net on images?

The functions Predict[] and Classify[] both have the option Method -> "NeuralNetwork", ...
32
votes
4answers
951 views
+100

How to make a custom NN layer in Mathematica?

Is there a way to create our own custom layers for Neural Networks in Mathematica ? I suspect it should be possible, any pointers or directions on how to go about it? I am interested in ...
13
votes
2answers
1k views

How to implement neural style transfer?

In the paper A Neural Algorithm of Artistic Style, Leon A. Gatys et all. describe a process of extracting the content and style vectors from an image separately. They use this technique to generate ...
17
votes
1answer
2k views

Reference request for neural network programming in Mathematica

I'm looking for a good reference/book on programming neural networks in mathematica. I've been working through Freeman's "Simulating Neural Networks with Mathematica," but it is from 1994 so is quite ...
19
votes
5answers
2k views

Recurrent neural network in 11.1 explicit examples?

I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
10
votes
1answer
939 views

How to change weights of a neural network

Is there a way to change the weights of a layer in a neural network, without reconstructing the whole network? For example, ...
13
votes
2answers
436 views

Simple example of NetGraph running in MXNet?

There is an great example of exporting a NetGraph (that was trained in Mathematica) into the MXNet's format. However, I think there's a bug or something is wrong with the answer, because once ...
11
votes
2answers
1k views

Sliding FullyConvolutional net over larger images

Take for instance the following net based on LeNet but with $1 \times 1$ convolutions instead of the MLP (the last two, fully connected layers) at the end of the classical LeNet. ...
8
votes
1answer
314 views

Can we implement a Neural Network interactively?

Implementing a Neural Network manually need some code and need to make some connections between these components. Can we implementing a Neural Network interactively?If I want to make a net like ...
12
votes
1answer
349 views

Using PredictorMeasurements with a neural net?

PredictorMeasurements doesn't work with NetGraph, here's an example: ...
11
votes
1answer
872 views

A comprehensive list of all correct input formats for [[experimental]] Neural Net functions?

Question: correct formats for Mathematica's NetTrain function Explanation of the problem Background So Mathematica 11 was released earlier this month, and while there are many improvements and they ...
10
votes
3answers
767 views

Using Mathematica wlnet model in C++

Suppose if there is a trained net: SeedRandom[1234]; net = NetInitialize@NetChain[{5, 3}, "Input" -> 2]; It can predict image in mma: ...
7
votes
1answer
386 views

Why I can only train some NetModel with GPU

I can train NetModel's models with CPU. I'm on Windows 10 with Mathematica 11.2 GPU is GTX1080 with 8G memory. My datasets is 1000 pictures with 224*224. I can train some NetModel like ...
19
votes
0answers
632 views

How to ImageRestyle high-res images?

I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels. All the examples in the documentation use images around 500 x 500 or ...
11
votes
1answer
328 views

Quantile Regression using Neural Networks (Custom Loss function)

I would like to perform a Quantile Regression within Mathematica's neural network framework. Since there exist a couple of tutorials for this exact problem in Tensorflow, i.e. Deep Quantile ...
10
votes
1answer
225 views

Can one use NetTrain with two Nvidia GPUs?

I am thinking of buying another GPU to accelerate my training. Will I be able to call NetTrain with both GPUs ("TargetDevice"-> {"GPU", All})? Or would it be ...
9
votes
2answers
271 views

Options for ValidationSet accuracy from NetTrain?

With NetTrain[] if you use the option ValidationSet->Scale[.1] it will run a validation test on 10% of the training data ...
8
votes
1answer
722 views

How to finetune a large pretrained NetModel?

Such an example is not in the docs so I'm posting this to clarify the process of finetuning. I'm looking for a minimal (but detailed) example of fine-tuning a pre-trained model with custom data (and ...
10
votes
1answer
416 views

Bug in Mathematica 12 neural networks?

I recently downloaded Mathematica 12, and I'm experiencing a curious failure in neural networks that had earlier worked. This failure I will demonstrate with the NN in "Classifying Data with Neural ...