All Questions
Tagged with machine-learning neural-networks
300 questions
91
votes
1
answer
14k
views
Crack CAPTCHA using deep learning
Deep convolutional neural networks are very good at computer vision related tasks. Optical Character Recognition (OCR) is one important branch of computer vision. In fact, the convolution neural ...
- 27.8k
73
votes
6
answers
5k
views
Q&A Mathematica v.11 Neural Networks: A comprehensive look at Layers, Net Functions, and pioneering into this [[experimental]] code
Motivation
As Mathematica v.11 was released earlier this month with a host of new [[experimental]] functions and a limited number of examples on curated data that ...
- 5,442
58
votes
5
answers
8k
views
Mathematica command that allows it to read my intentions
In version 2.0 of Mathematica there was a command, ReadProgrammerIntentions[ ] which allowed it rapidly compose code that could solve problems simple to complex, ...
48
votes
5
answers
4k
views
Generative Adversarial Network
Generative adversarial networks (GAN) is regarded as one of "the most interesting idea in the last ten years in machine learning" by Yann LeCun. It can be used to generate photo-realistic images that ...
- 27.8k
48
votes
2
answers
9k
views
Object detection and localization using neural network
Four important computer vision tasks are classification, localization, object detection and instance segmentation (image taken from cs224d course):
These four tasks are all built on top of the deep ...
- 27.8k
48
votes
3
answers
3k
views
Generalized Backpropagation for Neural Networks (e.g. DeepDream)
Is there currently any way to abuse NetTrain to maximize an arbitrary cost/utility -function in some hidden layer and/or even modify the input to increase neuron ...
- 8,529
40
votes
2
answers
2k
views
How can I export my learned ClassiferFunction[] and PredictorFunction[]s?
Mathematica 10 provides beautiful high-level machine learning functionality. Sadly, the learned functions once created are rather opaque objects. I need to use them in other projects, so here is my ...
- 3,820
36
votes
1
answer
3k
views
RNN in Mathematica?
Recurrent neural network is an important part of machine learning and its improved version: LSTM network is widely applied, but Mathematica seemingly is in lack of these two features and in my opinion,...
- 9,660
36
votes
2
answers
4k
views
Using a Convolutional Neural Network for time series classification
In the recent new in Mathematica 11 webinar one user asked during the Q&A session wether the current implementation of neural networks in Mathematica 11 could be used for processing time series. ...
- 8,529
35
votes
4
answers
1k
views
How to make a custom NN layer in Mathematica?
Is there a way to create our own custom layers for Neural Networks in Mathematica ? I suspect it should be possible, any pointers or directions on how to go about it?
I am interested in ...
- 401
28
votes
1
answer
2k
views
How to export an MXNet?
I was hoping there was some way to generate the .params and .json file needed to define an MXNet model, from a network trained using NetTrain[] in Mathematica. I ...
- 3,820
26
votes
1
answer
2k
views
How to monitor the process of Neural Network Learning
Main Problem
I'm exploring the neural network in v11 and I would like to monitor the training progress in my own way instead of Mathematica's default way. So my question is, how to do this ...
- 9,660
23
votes
1
answer
943
views
How to ImageRestyle high-res images?
I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels.
All the examples in the documentation use images around 500 x 500 or ...
- 31.8k
22
votes
5
answers
4k
views
Recurrent neural network in 11.1 explicit examples?
I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
- 12.1k
21
votes
1
answer
2k
views
How to import a Tensorflow model?
I've trained a network in Tensorflow and have the checkpoint files, I'd like to if anyone has written a parser or importer to pull the evaluation graph and/or weights into Mathematica?
- 3,820
21
votes
0
answers
744
views
Implementing Contextual Bandits
The multi-armed bandit problem (MAB) is a classic in Reinforcement learning. Now that Mathematica version 12 finally has support for Reinforcement learning:
Here's a nice "mnist example" for training ...
- 31.8k
20
votes
4
answers
1k
views
How to use Mathematica to train a network Using out of core classification?
I see there is doc about how to train a network Using out of core image classification and this question.But the object is only image.
I want to use a binary file as data(Sequence to Sequence case),...
- 6,866
20
votes
2
answers
1k
views
Training Neural Networks on Cloud GPUs (Wolfram Cloud / AWS / Paperspace /etc)
I have spent a lot of time lately training neural networks. However, my poor laptop has only an AMD GPU, so I am stuck training these networks on the CPU. That means I get to train networks over ...
- 13.2k
18
votes
2
answers
1k
views
Diffusion probabilistic model in deep generative modeling
Diffusion Models (http://proceedings.mlr.press/v37/sohl-dickstein15.html and https://arxiv.org/abs/2006.11239) are generative models gaining popularity in the community of deep generative modeling, ...
- 835
17
votes
1
answer
1k
views
How to implement a stateful RNN?
If the model is stateless, the cell states are reset at each example. With the stateful model, all the states are propagated to the next example. Stateful RNNs can learn the long sequences.
For ...
- 9,621
17
votes
1
answer
616
views
Stable diffusion models in WL?
Are there any diffusion-based (text + image) -> image generation models available in Mathematica, Wolfram Repositories, or from third parties?
In particular, I'm ...
- 31.8k
16
votes
1
answer
2k
views
How to visualize attention?
In the articles about sequence attention we can see images like this:
Here we see that while translating from French to English, the network attends sequentially to each input state, but sometimes it ...
- 9,621
15
votes
1
answer
509
views
Using PredictorMeasurements with a neural net?
PredictorMeasurements doesn't work with NetGraph, here's an example:
...
- 3,820
15
votes
1
answer
533
views
Minibatch Standard Deviation Layer
I'm reworking some of the GANs I originally made in TensorFlow2 to see if I can improve performance in Mathematica, and have been stuck on how to create a custom Minibatch Standard Deviation Layer. I'...
- 1,256
14
votes
3
answers
605
views
Importing a grid of numbers from an image (sudoku like)
Can anyone see a way to import a grid of numbers from
http://www.mit.edu/~puzzle/2019/puzzle/lantern_festival.html
into Mathematica? TextRecognize doesn't seem ...
- 6,697
14
votes
1
answer
2k
views
How do I configure the input and output layers of a neural network?
I'm confused about how to set some of the basic properties of a neural network structure using Classify.
I'm trying to set the basic properties of a simple neural ...
- 12.9k
14
votes
1
answer
918
views
Neural machine translation model using deep learning
In Mathematica version 11.1, SequenceAttentionLayer is introduced to model attentions in the recurrent neural network. It has been shown that attention mechanism ...
- 27.8k
14
votes
1
answer
302
views
WLNet format incompatible between version 11.0 and 11.1
It seems that there are some behavior changes of neural network layers from version 11.0 to 11.1 that leads to the incompatibility of WLNet format.
Consider this example:
Network exported in 11.0
<...
- 27.8k
14
votes
1
answer
2k
views
Is there any decent deep learning library in Mathematica?
Deep Learning is the currently trending method in machine learning community. Some languages like python and matlab have some very convenient toolbox for deep learning. So is there any decent deep ...
- 1,582
14
votes
0
answers
604
views
How to plug holes in an Image (with partial convolutions)?
NVIDIA recently published a new way to reconstruct images with holes. They use a new type of convolutional layer which is described in the paper Image Inpainting for Irregular Holes Using
Partial ...
- 3,820
14
votes
0
answers
1k
views
Neural network playground [closed]
I came across this Neural Net Playground demonstration based on Google's Tensorflow package. It visualizes the data processing inside a neural network and allows you to tweak parameters and ...
- 31.8k
13
votes
2
answers
2k
views
How to change NeuralNetwork options?
How can I manipulate the architecture and problems of a NeuralNetwork in Predict or Classify? For example, running the following ...
- 968
13
votes
2
answers
3k
views
How to train a convolutional neural net on images?
The functions Predict[] and Classify[] both have the option Method -> "NeuralNetwork", ...
- 31.8k
13
votes
2
answers
1k
views
Implementing a Neural Network
TLDR: I am implementing a neural net in Mathematica and need help with back propagation.
This is purely for the joy of implementing a neural network with a functional programming language. If someone ...
- 357
13
votes
2
answers
790
views
How to implement a triplet network with NetSharedArray?
In v11.3, NetSharedArray[] and NetInsertSharedArray[] give us a mechanism of sharing weights and biases across neural networks, ...
- 31.8k
13
votes
1
answer
618
views
Wolfram Neural Net Repository Questions
I was a research scientist in the machine learning team, and mostly involved with the neural net repository.
- 131
13
votes
1
answer
9k
views
How can image segmentation from UNET be improved?
EDIT 2: code can be found @ https://github.com/alihashmiii/UNet-Segmentation-Wolfram
EDIT 1: applying Binarize to the masks after resizing helps to ensure the data for mask is binary
I have made an ...
- 9,060
13
votes
2
answers
524
views
Simple example of NetGraph running in MXNet?
There is an great example of exporting a NetGraph (that was trained in Mathematica) into the MXNet's format.
However, I think there's a bug or something is wrong with the answer, because once ...
- 3,820
12
votes
4
answers
2k
views
Text recognition - extracting table of text from image
I want to extract table from the image bellow as a list of strings. I tried the following but it does not work.
...
- 25.1k
12
votes
3
answers
775
views
How to make Advanced Activations Layers in Mathematica?
I want to try Advanced Activations Layers in Mathematica,but not found.
So I try to use ElementwiseLayer to implement it.
...
- 6,866
12
votes
1
answer
1k
views
Configuring GPU for NetTrain
I currently have access to a system with two GPUs:
GeForce GTX 1080 and Tesla K40c
I would like to use this machine for training neural networks in Mathematica.
When using the option ...
- 1,410
12
votes
1
answer
974
views
Same neural network gives different results
I was playing with the neural network in Mathematica and found that the same neural network gives different classification results to the same image, which is very strange.
Consider classifying this ...
- 27.8k
12
votes
1
answer
422
views
How to determine which Layers should be used in my NetChain?
I have a answer in this post which is based on neural network,but I have to say that reault is too bad and have no practicability.I think the reason is that selection of network layers.So I give some ...
- 27.2k
11
votes
3
answers
994
views
Using Mathematica wlnet model in C++
Suppose if there is a trained net:
SeedRandom[1234];
net = NetInitialize@NetChain[{5, 3}, "Input" -> 2];
It can predict image in mma:
...
- 6,866
11
votes
1
answer
358
views
Apply Result of NetTrain using GPU?
I'v trained a deep network (e.g. LeNet) using NetTrain with TargetDevice -> "GPU". Everything works well and it is really fast. But now I have a trained network and tens of thousands of samples to ...
- 647
11
votes
1
answer
394
views
NetEncoder for images of "Varying" dimension?
I'm looking for someway to do what this syntax "should" do:
NetEncoder[{"Image", Automatic, ColorSpace -> "RGB"}] /@ imgs;
The documentation states that ...
- 31.8k
11
votes
2
answers
703
views
How to combine Neural Network and Audio like Classify?
I want to combine Audio object and Neural Network ,first thing I remember is Classify
...
- 6,866
11
votes
1
answer
406
views
How to view ClassifierFunction's preprocessed data?
Classify apparently preprocesses your input data, for example (same example from Classify reference page, but using ...
- 360
11
votes
1
answer
870
views
How to use an external GPU to train neural networks in Mathematica?
Taking steps in the uncharted territories of eGPUs, I have installed an NVIDIA GeForce Titan Xp GPU on an eGPU enclosure (Mantiz MZ-02) and have connected it to my laptop (HP Spectre x360 - 15-bl075nr ...
- 1,883
11
votes
1
answer
1k
views
Neural Networks in Predict function
I'm trying to reproduce the result giving by a Predict function with a Neural Network as the chosen method.
So, I'm training from this set:
...
- 981