100
votes
Crack CAPTCHA using deep learning
Here is one example using a convolutional neural network (CNN) to crack the CAPTCHA. We will use a CAPTCHA library to generate sample CAPTCHA images and then train a neural network to decode these ...
59
votes
Object detection and localization using neural network
Introduction
An object detection problem can be approached as either a classification problem or a regression problem. As a classification problem, the image is divided into small patches, each of ...
41
votes
Accepted
Mathematica command that allows it to read my intentions
Indeed, this functionality still exists, but it has been moved into its own package.
Load the package:
Needs["aBetterProgrammer`"]
You will have access to such ...
Community wiki
32
votes
Accepted
Neural Networks: Does Mathematica (v11) experimental code support state-of-art Models?
Mathematica's neural network functionality is based on MXNET. So you can use pre-trained models for MXNET or create and train state-of-the-art models with NetGraph.
...
30
votes
Accepted
Generative Adversarial Network
I wrestled with this for a while and got some kind of results, but nowhere near the great performance for which GANs are famous. Ultimately, they're absurdly sensitive to hyperparameters and ...
27
votes
How to export an MXNet?
It seems the model file in MXNet (checkpoint) is defined by two files: a ".json" file and a ".params" file. The json file contains the definition of the network, and the params file contains the ...
26
votes
Accepted
Generalized Backpropagation for Neural Networks (e.g. DeepDream)
Sebastian mentioned in his answer that deepdream can be possible using NetDerivative. Here are my attempts following his outlines.
Instead of using the inception ...
25
votes
Mathematica command that allows it to read my intentions
Since version 11 most commands finally support the Interpretation option: Interpretation -> "Literal" being the classical (...
Community wiki
25
votes
Mathematica command that allows it to read my intentions
I tend to use a pattern matching approach:
myCode/.{x_?BugQ:>BugStrip[x],x_?TypoQ:>Detypo[x],x_?WrongSignQ:>-x,x_?OffBy2PiQ:>x*2\[Pi]}
With the usual ...
Community wiki
23
votes
Neural network illustrations
Below is given a function definition that can be used to make a neural network plot with formulae and activation functions graphics. The code/plot can be garnished some more, but at this point I find ...
22
votes
Neural Networks: Does Mathematica (v11) experimental code support state-of-art Models?
Bring in pre-trained models is sometimes very useful. Alexey's answer is somewhat brief, here I'm trying to add some examples hopefully will be helpful.
We can load the trained network by
...
21
votes
21
votes
Accepted
Convert List of Associations into Association of Lists
You can use the undocumented AllowedHeads option of Transpose to do this:
...
21
votes
Mathematica command that allows it to read my intentions
This function was deprecated in V4.2, being succeeded by CellularAutomaton.
Since your answer is hidden somewhere in rules like 110, why reinvent the wheel with <...
Community wiki
20
votes
Accepted
Recurrent neural network in 11.1 explicit examples?
Here is a simple example that may help you get started. In this example, we are going to a predict a simple time series of a sinusoid wave.
...
18
votes
Accepted
How do I configure the input and output layers of a neural network?
I think it would be simpler to construct the simple neural network rather than setting the properties in Classify. Here is an example using a three-layer net to ...
18
votes
Neural Network for polynomial fit
... however in Mathematica the net always performs a linear fit, no matter how many layers und neurons I use.
I'm guessing you're using only DotPlusLayers. These ...
18
votes
Can we implement a Neural Network interactively?
Update:
So after adding the missing features I decided to give your actual problem a go. This is what I have:
You'll note a little "Add Layer" ActionMenu ...
18
votes
Accepted
Importing a grid of numbers from an image (sudoku like)
1 - Summary of a simple solution
In this particular DIGIT case there is a very simple solution based on neural nets (NNs)trained on MNIST Data. It is just a few lines of code:
...
17
votes
Generative Adversarial Network
Yes it is possible. You can do alternating training manually by literally following the algorithm, so that you have a Do loop whose body contains two calls to NetTrain, but that suffers from overhead ...
17
votes
Accepted
How to use Mathematica to train a network Using out of core classification?
Okay here's how you do out-of-core training with HDF5:
...
17
votes
Neural network illustrations
A bit different function that always places vertices symmetrically:
...
17
votes
Accepted
Improve scanned image with handwritten text for high-contrast printing: how it can be done with Mathematica?
First attempt with acceptable result
Here is an approach which gives a satisfactory result. ColorsNear by default uses the ...
16
votes
How to make a custom NN layer in Mathematica?
Supporting custom layers is on our to-do list, and should be ready for either 11.2 or 11.3.
For interest: what applications do you want custom layers for? And how performant do you need your custom ...
16
votes
How to use Mathematica to train a network Using out of core classification?
There are two parts to your question: 1. How to use out-of-core classification and 2. Why is the result bad.
For the first part, you can use a generator to solve the problem. And for the second part, ...
16
votes
Recurrent neural network in 11.1 explicit examples?
Taking inspiration from the answer by xslittlegrass, I came up with the following solution.
Recall the sample data from this question. We have an observable obs we ...
16
votes
Accepted
Creating an indicator function in a neural network
You can construct an IndexMaxLayer using the existing layers, like so:
...
16
votes
Accepted
How to implement graph neural networks in Mathematica?
Background
Graphs can be thought as generalized images where each node can have arbitrary neighbors instead of strict grid neighbors. The simplest graph network is the graph convolutional network (GCN)...
15
votes
How to use Mathematica to train a network Using out of core classification?
@xslittlegrass's answer is perfect, but I want to give a heads up that we will ship a way to stream training data to NetTrain from an ".h5" file that can be arbitrarily big (e.g. hundreds of gigabytes)...
14
votes
Accepted
How to implement neural style transfer?
Example from NetTrain documentation (Applications - Computer Vision - Style Transfer):
...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
neural-networks × 586machine-learning × 300
image-processing × 29
gpu × 28
mxnet-format × 22
bugs × 16
list-manipulation × 15
graphs-and-networks × 12
mathematical-optimization × 11
warning-messages × 11
export × 10
fitting × 10
dynamic × 9
implementation-details × 8
sound × 8
computer-vision × 8
graphics × 7
import × 7
convolution × 6
image × 5
wolfram-cloud × 5
time-series × 5
natural-language × 5
plotting × 4
differential-equations × 4