Questions tagged [machine-learning]
Questions about machine learning functionality of Mathematica, for instance involving, but not restricted to, Predict, Classify, FindClusters and the various regression functions.
665
questions
91
votes
1
answer
14k
views
Crack CAPTCHA using deep learning
Deep convolutional neural networks are very good at computer vision related tasks. Optical Character Recognition (OCR) is one important branch of computer vision. In fact, the convolution neural ...
- 27.4k
83
votes
8
answers
15k
views
What are the Wolfram Language's relative strengths for machine learning?
I see a low use of Mathematica in Kaggle competitions.
Why would one use the Wolfram Language versus R, Python, or Julia for machine learning?
Besides prettier plots and the Manipulate function, ...
- 2,393
73
votes
6
answers
5k
views
Q&A Mathematica v.11 Neural Networks: A comprehensive look at Layers, Net Functions, and pioneering into this [[experimental]] code
Motivation
As Mathematica v.11 was released earlier this month with a host of new [[experimental]] functions and a limited number of examples on curated data that ...
- 5,362
58
votes
5
answers
8k
views
Mathematica command that allows it to read my intentions
In version 2.0 of Mathematica there was a command, ReadProgrammerIntentions[ ] which allowed it rapidly compose code that could solve problems simple to complex, ...
48
votes
2
answers
8k
views
Object detection and localization using neural network
Four important computer vision tasks are classification, localization, object detection and instance segmentation (image taken from cs224d course):
These four tasks are all built on top of the deep ...
- 27.4k
48
votes
3
answers
3k
views
Generalized Backpropagation for Neural Networks (e.g. DeepDream)
Is there currently any way to abuse NetTrain to maximize an arbitrary cost/utility -function in some hidden layer and/or even modify the input to increase neuron ...
- 8,399
47
votes
5
answers
4k
views
Generative Adversarial Network
Generative adversarial networks (GAN) is regarded as one of "the most interesting idea in the last ten years in machine learning" by Yann LeCun. It can be used to generate photo-realistic images that ...
- 27.4k
42
votes
1
answer
3k
views
How to perform document classification (i.e. extracting topics from text)?
I need to build a multi-label text classifier. There are a bunch of techniques for doing this, and it's called automatic document classification. I'm trying to use the EM technique (expectation ...
- 3,601
40
votes
2
answers
2k
views
How can I export my learned ClassiferFunction[] and PredictorFunction[]s?
Mathematica 10 provides beautiful high-level machine learning functionality. Sadly, the learned functions once created are rather opaque objects. I need to use them in other projects, so here is my ...
- 3,601
37
votes
3
answers
2k
views
What is behind experimental function: FindFormula?
In version 10.2 there is a new experimental function: FindFormula[].
I suspect that a genetic programming algorithm (symbolic regression) is behind this new ...
- 1,595
36
votes
1
answer
3k
views
RNN in Mathematica?
Recurrent neural network is an important part of machine learning and its improved version: LSTM network is widely applied, but Mathematica seemingly is in lack of these two features and in my opinion,...
- 9,518
36
votes
2
answers
2k
views
Handwriting recognition with Mathematica
I am trying to teach Mathematica to read my handwriting. Since I don't want to ruin my reputation by showing my own handwriting, I am going to use a font called blackjack.
Lets say this is a ...
- 15.9k
35
votes
4
answers
1k
views
How to make a custom NN layer in Mathematica?
Is there a way to create our own custom layers for Neural Networks in Mathematica ? I suspect it should be possible, any pointers or directions on how to go about it?
I am interested in ...
- 401
35
votes
2
answers
4k
views
Using a Convolutional Neural Network for time series classification
In the recent new in Mathematica 11 webinar one user asked during the Q&A session wether the current implementation of neural networks in Mathematica 11 could be used for processing time series. ...
- 8,399
28
votes
1
answer
2k
views
How to export an MXNet?
I was hoping there was some way to generate the .params and .json file needed to define an MXNet model, from a network trained using NetTrain[] in Mathematica. I ...
- 3,601
28
votes
2
answers
743
views
Frown for a sex change, or, how do I unbork the "FacialGender" classifier in 11.2?
The limits of machine learning. I thought the new "FacialGender" option for Classifier would be an amusing thing to ...
- 34.1k
26
votes
1
answer
2k
views
How to monitor the process of Neural Network Learning
Main Problem
I'm exploring the neural network in v11 and I would like to monitor the training progress in my own way instead of Mathematica's default way. So my question is, how to do this ...
- 9,518
24
votes
1
answer
6k
views
How can I detect if an image is of poor quality?
I need to filter out blurry or otherwise bad quality images from a set. I would like an efficient method to detect images that have any of the following three attributes:
Out of focus or motion blur
...
- 31.2k
22
votes
5
answers
4k
views
Recurrent neural network in 11.1 explicit examples?
I heard that RNN was implemented in Mathematica as of 11.1. Trying to search online, I find some general information about neural networks in Mathematica, or a list of related functions. My trouble is ...
- 11.9k
22
votes
0
answers
842
views
How to ImageRestyle high-res images?
I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels.
All the examples in the documentation use images around 500 x 500 or ...
- 31.2k
21
votes
4
answers
544
views
Find best region to put text onto image
Given an image upon which you want to inset text, the question arises:
What is the best sub-region to place text?
For example, given a background image I want to find the rectangle in the image (...
- 31.2k
21
votes
2
answers
2k
views
How to know the internal algorithms of functions like Predict or Classify?
The document centre seems only explain how to use these functions, but just in an very brief way. I know Mathmatica is not open source, so we can not expect to see the code of the function, but are ...
- 1,582
21
votes
1
answer
313
views
Inefficient memory storage for Dataset
Why Dataset doesn't serialize its contents, isn't it the whole point? I expect it to behave similar to python's pandas.DataFrame,...
- 7,611
21
votes
1
answer
2k
views
How to import a Tensorflow model?
I've trained a network in Tensorflow and have the checkpoint files, I'd like to if anyone has written a parser or importer to pull the evaluation graph and/or weights into Mathematica?
- 3,601
21
votes
0
answers
696
views
Implementing Contextual Bandits
The multi-armed bandit problem (MAB) is a classic in Reinforcement learning. Now that Mathematica version 12 finally has support for Reinforcement learning:
Here's a nice "mnist example" for training ...
- 31.2k
20
votes
2
answers
5k
views
Machine learning. SVM algorithm
I want to work with machine learning in Mathematica. Are there any SVM algorithms implemented in Mathematica anywhere? Or any other algorithms for machine learning? With positive and negative database ...
- 978
20
votes
1
answer
1k
views
Biased results when using Method -> "RandomForest" in Predict
I am interested in using random forests for some prediction, so I have been using Predict. I find that "RandomForest" method ...
- 543
19
votes
4
answers
1k
views
How to use Mathematica to train a network Using out of core classification?
I see there is doc about how to train a network Using out of core image classification and this question.But the object is only image.
I want to use a binary file as data(Sequence to Sequence case),...
- 6,776
19
votes
2
answers
1k
views
Training Neural Networks on Cloud GPUs (Wolfram Cloud / AWS / Paperspace /etc)
I have spent a lot of time lately training neural networks. However, my poor laptop has only an AMD GPU, so I am stuck training these networks on the CPU. That means I get to train networks over ...
- 13k
18
votes
2
answers
3k
views
How to split a Dataset into training and testing for machine learning?
Suppose I have iris data In the Dataset Format.
How to split the iris data Into training and testing for Machine learning?
For example,Transform the data for Classify.
- 598
17
votes
2
answers
942
views
Diffusion probabilistic model in deep generative modeling
Diffusion Models (http://proceedings.mlr.press/v37/sohl-dickstein15.html and https://arxiv.org/abs/2006.11239) are generative models gaining popularity in the community of deep generative modeling, ...
- 825
17
votes
1
answer
1k
views
How to implement a stateful RNN?
If the model is stateless, the cell states are reset at each example. With the stateful model, all the states are propagated to the next example. Stateful RNNs can learn the long sequences.
For ...
- 9,486
17
votes
2
answers
330
views
How to export a ContentDetectorFunction for use in Python?
For text and images v13 introduces the ability to train detectors easy which result in ContentDetectorFunction's. To use these IRL we need to export to python's ...
- 31.2k
16
votes
2
answers
2k
views
Trainable WEKA segmentation of images
Is there a Mathematica equivalent of Trainable WEKA Segmentation as implemented in Fiji, the image processing software? A Google search did not return any relevant links.
I attach the original image ...
- 459
16
votes
1
answer
2k
views
How to visualize attention?
In the articles about sequence attention we can see images like this:
Here we see that while translating from French to English, the network attends sequentially to each input state, but sometimes it ...
- 9,486
16
votes
1
answer
2k
views
Classify command in Mathematica 10
Where can I find documentation about the methods used in the Classify command in Mathematica 10? Specifically, how does the method ...
16
votes
1
answer
2k
views
Implementing t-SNE (t-Distributed Stochastic Neighbor Embedding)
Context
Six months ago @M.R. asked about an implementation of the t-Distributed Stochastic Neighbor Embedding (t-SNE) algorithm by van der Maaten and Hinton (2008). (@M.R.'s question)
@Alexey Golyshev ...
- 5,362
16
votes
1
answer
476
views
Stable diffusion models in WL?
Are there any diffusion-based (text + image) -> image generation models available in Mathematica, Wolfram Repositories, or from third parties?
In particular, I'm ...
- 31.2k
16
votes
0
answers
601
views
How to reconstruct 3d meshes from 2d images of a scene?
The new ImageStitch was nice functionality added in v13, but is there anything available for constructing meshes (with color textures) from a bag of 2D images (...
- 31.2k
15
votes
2
answers
1k
views
How to do Independent Component Analysis?
The new experimental function in 10.3.1 DimensionReduce[], has the following three options for Method:
...
- 31.2k
15
votes
3
answers
2k
views
Transform Dataset so it can be used as training set for Classify
Trying to learn the new Dataset features, I am playing with the iris dataset:
...
- 1,383
15
votes
1
answer
464
views
Rapid density estimation and rendering of decision regions
I would like to create an interactive demonstration using Manipulate[] that illustrates a fundamental concept in pattern classification and machine learning. This ...
- 39.9k
15
votes
3
answers
1k
views
Inverse of Interpreter["Color"]: Convert a RGBColor to a natural language color name
What is the best way to create the inverse function of Interpreter["Color"]? That function takes a natural language color name like ...
- 939
15
votes
1
answer
5k
views
How to visualize a random forest classifier?
I'd like to recreate this visualization (from python) in Mathematica:
I'm not sure how to extract the decision boundaries from a classifier with "Method" set to "RandomForest".
Here's the code:
<...
- 31.2k
15
votes
1
answer
507
views
Minibatch Standard Deviation Layer
I'm reworking some of the GANs I originally made in TensorFlow2 to see if I can improve performance in Mathematica, and have been stuck on how to create a custom Minibatch Standard Deviation Layer. I'...
- 1,156
14
votes
2
answers
1k
views
How to detect loops in a vector field?
Given a vector field and I'd like to detect if there are streamlines in closed patterns. For example, if the input is a vector field like this:
...
- 31.2k
14
votes
3
answers
584
views
Importing a grid of numbers from an image (sudoku like)
Can anyone see a way to import a grid of numbers from
http://www.mit.edu/~puzzle/2019/puzzle/lantern_festival.html
into Mathematica? TextRecognize doesn't seem ...
- 8,061
14
votes
1
answer
2k
views
How do I configure the input and output layers of a neural network?
I'm confused about how to set some of the basic properties of a neural network structure using Classify.
I'm trying to set the basic properties of a simple neural ...
- 12.8k
14
votes
1
answer
893
views
Neural machine translation model using deep learning
In Mathematica version 11.1, SequenceAttentionLayer is introduced to model attentions in the recurrent neural network. It has been shown that attention mechanism ...
- 27.4k
14
votes
1
answer
298
views
WLNet format incompatible between version 11.0 and 11.1
It seems that there are some behavior changes of neural network layers from version 11.0 to 11.1 that leads to the incompatibility of WLNet format.
Consider this example:
Network exported in 11.0
<...
- 27.4k