Questions tagged [machine-learning]

Questions about machine learning functionality of Mathematica, for instance involving, but not restricted to, Predict, Classify, FindClusters and the various regression functions.

182 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
21
votes
0answers
536 views

Implementing Contextual Bandits

The multi-armed bandit problem (MAB) is a classic in Reinforcement learning. Now that Mathematica version 12 finally has support for Reinforcement learning: Here's a nice "mnist example" for training ...
21
votes
0answers
770 views

How to ImageRestyle high-res images?

I’m running v12 now and ImageRestyle[] crashes for me on an image of size 1600 x 1200 pixels. All the examples in the documentation use images around 500 x 500 or ...
14
votes
0answers
564 views

How to plug holes in an Image (with partial convolutions)?

NVIDIA recently published a new way to reconstruct images with holes. They use a new type of convolutional layer which is described in the paper Image Inpainting for Irregular Holes Using Partial ...
12
votes
0answers
253 views

Trying to build a code to translate handwritten formulas using ML

I'm lazy writing equations in Latex so I want a code to translate handwritten equations. This question is related to an old experiment I'm reviewing during vacations, here. I'm trying to use ...
11
votes
0answers
200 views

Tutorial example NetTrain fails miserably with a GPU

I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
10
votes
0answers
640 views

How to train a bounding box detection model?

Apparently, this still isn't possible in v12? I'd like to add a new class to one of the standard object detection architectures. Consider the YOLO v2 detector from the Neural Net Repo. ...
9
votes
0answers
272 views

How to extract tree parameters from RandomForest?

I want to extract the parameters of a decision tree from the object estimated by Classify[]. It seems that parameters of the estimated Classifier are available in the "Models" property. It is ...
9
votes
0answers
225 views

What are the time and space complexities of Classify/Predict?

Does anyone have knowledge of the O(n) time & space complexities for various model types supported by Classify[] and ...
8
votes
1answer
296 views

Can LearnDistribution learn conditionality?

I would like to apply LearnDistribution to multivariate conditional distributions. Here's a simple artificial example: ...
8
votes
0answers
139 views

Slow down training many neural networks (Bug?)

I am working on something in which I need to train a neural network many times with slightly different training data. I noticed that after many training runs the input rate had dropped significantly. ...
8
votes
0answers
366 views

Use of new machine learning capability for search problems (reinforcement learning)

I work with search algorithms, often of an adversarial nature, and want to understand how to apply Mathematica's machine learning capabilities, especially those new in version 11, to this type of ...
8
votes
0answers
312 views

Exporting Classify Models

Currently I have created a simple classifier to classify sentiment from a string of text (or a tweet). The code is very basic and looks something like this: ...
6
votes
0answers
117 views

Extracting information from Classify

I have used Mathematica's automated Classify function: ...
6
votes
0answers
161 views

How can I prevent errors with ReplicateLayer[]?

I am trying to build a NetGraph[] that takes input of the form {{0.6},{0.6},...,{0.8},{0.8}} and multiplies the last sequence ...
6
votes
0answers
98 views

How can one train a Neural Network in Mathematica such as to recognise and count all occurrences of a certain custom category in an image?

I'm trying to use Mathematica for the following task: (1) Get an aereal view of a certain area in Mongolia (2) Count the number of plots that contain houses, and the number of plots that contain ...
6
votes
0answers
156 views

Export ImageCases to Python?

I’d like a tutorial on how to export a bounding box detector network to mxnet, (for bonus points: convert to Tensorflow), and then get it running correctly in python! Some related questions exist for ...
6
votes
0answers
131 views

Can I use Mathematica ML capability to translate an image of a formula?

If I am given a pdf image of a mathematical symbolic formula can I translate it into Mathematica syntax using ML? I tried using Classify, but I can only translate parts of the equation and I don't ...
6
votes
0answers
138 views

How to extend ImageCases?

I was very excited to see ImageCases being documented in version 12. But I immediately desired a mechanism for adding more entities to ...
6
votes
1answer
474 views

Image Generator with a Neural Network (CIFAR-10)

As some of you may know, CIFAR-10 is a data base which has 60,000 images (which are 32x32 in size) of 10 different categories (airplane, dog, cat, frog, deer, bird, horse, ship, automobile and truck). ...
6
votes
0answers
328 views

How "good" is the new Classify and how does it choose its method

I recently read the blog regarding data-science Wolfram Blog and then checked the quality of the new Classify. I have a bunch of slides that I show to my students ...
6
votes
0answers
101 views

What algorithm is BayesianMaximization using?

The docs show the following options for BayesianMaximization's Method: "MaxExpectedImprovement" maximize expected improvement over current best value "MaxImprovementProbability" maximize ...
6
votes
0answers
153 views

Create ClassifierFunction

Is there a way to create my own ClassifierFunction? I would like to combine predictions from multiple independent classifiers into a single ensemble ClassifierFunction and be able to use things like ...
6
votes
0answers
124 views

How can I change the distance function in Classify when using NearestNeighbor?

Issue not present in version "10.4.1 for Linux x86 (64-bit) (April 11, 2016)" ...
5
votes
0answers
82 views

How to train each layer in a Neural Network so they optimize different loss functions in an adversarial network?

Example NetGraph to illustrate the idea (Input is an online signal with a value between -1 and 1, Noise is Gaussian Centered at 0 and standard deviation 0.1, EvilNet is constrained to output a value ...
5
votes
0answers
132 views

Seq2Seq RNN with an AttentionLayer

In many Sequence to Sequence machine learning tasks, an Attention Mechanism is incorporated. Before Transformer Networks, introduced in the paper: Attention Is All You Need, mainly RNNs were used to ...
5
votes
0answers
96 views

Recognising people from photos

I have a large number (probably 10000) of personal photos taken over the last few years, a good proportion of which contain family members. I'd like to put together a photo book of one family member,...
5
votes
0answers
119 views

Reverse Engineering of MMA `Classify[]` Output?

Update: as @AntonAntoniv rightly noticed in his comment the case of DecisionTree is already discussed. Now it would be great to also have an equivalent answer for LogisticRegression. MMA is really ...
5
votes
0answers
110 views

Can I extract symbolic expression of neural network loss function?

Once we create a neural network with NetChain in Mathematica, can we extract the loss function in the symbolic form for Mathematica to play with symbolic manipulations using Mathematica's built-in ...
5
votes
0answers
61 views

How to make the clustering result of version 11.2 and 11.3 same?

I was doing clustering analysis in version 11.2, with codes like below, and then got 12 clusters as the output: ...
5
votes
0answers
134 views

How to explain overfitting?

SeedRandom[0]; X = RandomInteger[{1, 5000}, {100000, 50}]; Y = RandomInteger[{0, 1}, 100000]; For net1 and ...
5
votes
0answers
131 views

What's BayesianMinimization and related functions based on?

Is it specified anywhere what the backend is for the Bayesian optimization related functionality in Mathematica v11? I'm specifically referring to the Bayesian* ...
5
votes
0answers
147 views

How to train further in Predict?

Training further means we can get much smaller loss in the training set,and maybe get the smaller loss in the validation set,so this is useful. For example ...
5
votes
0answers
237 views

Is Mathematica a good choice for a scientific project with Machine Learning?

I'm a chemist with some rudimentary programming skills and in the middle of the year I'll be starting a project concerning machine learning, so, I'm sorry if I'm going to ask two questions in this ...
5
votes
0answers
461 views

How to train a visual attention model?

In version 11.1 there is a new layer type SequenceAttentionLayer[]. I'm interested in how might this be used to train a recurrent visual attention model (see the ...
5
votes
0answers
375 views

Softmax Regression Classification Algorithm

I'm following the Stanford Machine Learning course while simultaneously developing my Mathematica abilities. I'm having issues with my Softmax Classifier implementation (for ref, have a look at these ...
4
votes
0answers
52 views

Modern topic modeling?

This question was asked in 2014: How to perform document classification (i.e. extracting topics from text)? At the time user @V.E. gave a great little tutorial on LDA, but today, there's still no ...
4
votes
0answers
148 views

Probem of Classify's Tree Method in Batch Predict

$Version 12.1.0 for Microsoft Windows (64-bit) (March 14, 2020) ...
4
votes
0answers
96 views

Neural network for a simple game?

I'm taking a class that is based on the Mathematica coding language, and we must do a 6-week final project. I am considering coding a neural network for a simple game like 2048, pacman, snake, etc. ...
4
votes
0answers
75 views

Is there a way to get the decision trees used by machine learning methods like `RandomForest`?

I was looking at a tutorial of SimFin, a new German-based financial data provider. There is a nice example of machine learning using sklearn in python. The package ...
4
votes
0answers
222 views

Image-based reinforcement learning with neural networks

After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
4
votes
0answers
111 views

How to get features for captioned images?

I have a lots of (image, text) pairs and would like to learn a feature extractor (or maybe a FeatureExtractorFunction) for a combined embedding. It seems that when given a list of these multimodal ...
4
votes
0answers
249 views

Visualizing and Understanding CNN with Mathematica

The famous 2013 paper from Zeiler and Fergus "Visualizing and Understanding Convolutional Networks" proposes a method to understand the behavior of CNN using one (or more) DeConv networks coupled with ...
4
votes
0answers
83 views

How to implement external memory for the "memory augmented neural network"?

I am trying to implement the memory-augmented neural network using MMA 11.3. The memory-augmented neural network in based on the paper here. There are implementations using ...
4
votes
0answers
75 views

Candidate sampling for softmax neural networks in mathematica

Though I've been using mathematica for a few years, I've never really delved into its ML capabilities (except for the occasional clustering). I'm curious if anyone who has some experience using ...
4
votes
0answers
122 views

Capsule Network reconstruction layer

I am experimenting the capsule network, using the architecture provided here: Capsule Network in Mathematica Deep Neural Network Repository While I can figure out what the network do following the ...
4
votes
0answers
136 views

Implementing Mathematica Machine Learning Algorithm in an HTML-Web Page

I have a Mathematica Neural Network developed in Mathematica 11.2 that I'd like to upload and use on my website. The algorithm takes in images as an input. My website is built with HTML-CSS and Flask. ...
4
votes
0answers
120 views

In neural network, how to force the NetTrain to use full batch gradient descent instead SGD?

In a neural network, I want to use full batch gradient descent instead of SGD. Currently, I am using code like this (you can see that I forced BatchSize to be the ...
4
votes
0answers
177 views

YOLOv3 Netmodel?

I see that YOLOv2 is on the Wolfram net repo, but has anyone ported the new YOLO version 3 architecture into Mathematica?
4
votes
0answers
147 views

Can someone help me to understand sequence-to-sequence transformation using (Wolfram-specific) recurrent neural nets?

I've been learning about recurrent neural networks lately and I think I'm starting to get the basic idea of how they work. I'm particularly interested in the sequence transformation capabilities of ...
4
votes
0answers
465 views

Using Machine Learning techniques for text-analysis

I am analysing a bunch of tweets and I want to understand which political party the authors support. Let say, for example that I have five parties labelled by a number: ...