All Questions
Tagged with machine-learning or machine-learning
234 questions with no upvoted or accepted answers
21
votes
0
answers
744
views
Implementing Contextual Bandits
The multi-armed bandit problem (MAB) is a classic in Reinforcement learning. Now that Mathematica version 12 finally has support for Reinforcement learning:
Here's a nice "mnist example" for training ...
- 31.8k
16
votes
0
answers
698
views
How to reconstruct 3d meshes from 2d images of a scene?
The new ImageStitch was nice functionality added in v13, but is there anything available for constructing meshes (with color textures) from a bag of 2D images (...
- 31.8k
14
votes
1
answer
2k
views
M1 Apple silicon ML performance
Testing out a new M1 Macbook pro with Mathematica 13.0.0. I verified that I used the correct version and it is running natively on ARM.
Mathematica in general runs great, and much fast than on my ...
- 141
14
votes
0
answers
604
views
How to plug holes in an Image (with partial convolutions)?
NVIDIA recently published a new way to reconstruct images with holes. They use a new type of convolutional layer which is described in the paper Image Inpainting for Irregular Holes Using
Partial ...
- 3,830
13
votes
0
answers
608
views
Trying to build a code to translate handwritten formulas using ML
I'm lazy writing equations in Latex so I want a code to translate handwritten equations. This question is related to an old experiment I'm reviewing during vacations, here. I'm trying to use ...
- 517
11
votes
0
answers
235
views
Tutorial example NetTrain fails miserably with a GPU
I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
- 19.1k
10
votes
0
answers
786
views
How to train a bounding box detection model?
Apparently, this still isn't possible in v12?
I'd like to add a new class to one of the standard object detection architectures. Consider the YOLO v2 detector from the Neural Net Repo.
...
- 31.8k
9
votes
0
answers
394
views
How to extract tree parameters from RandomForest?
I want to extract the parameters of a decision tree from the object estimated by Classify[].
It seems that parameters of the estimated Classifier are available in the "Models" property. It is ...
- 2,016
9
votes
0
answers
235
views
What are the time and space complexities of Classify/Predict?
Does anyone have knowledge of the O(n) time & space complexities for various model types supported by Classify[] and ...
- 31.8k
9
votes
0
answers
359
views
Exporting Classify Models
Currently I have created a simple classifier to classify sentiment from a string of text (or a tweet). The code is very basic and looks something like this:
...
- 381
8
votes
0
answers
156
views
Slow down training many neural networks (Bug?)
I am working on something in which I need to train a neural network many times with slightly different training data. I noticed that after many training runs the input rate had dropped significantly.
...
- 363
8
votes
0
answers
433
views
Use of new machine learning capability for search problems (reinforcement learning)
I work with search algorithms, often of an adversarial nature, and want to understand how to apply Mathematica's machine learning capabilities, especially those new in version 11, to this type of ...
- 4,102
7
votes
0
answers
159
views
How to extend ImageCases?
I was very excited to see ImageCases being documented in version 12. But I immediately desired a mechanism for adding more entities to ...
- 31.8k
7
votes
1
answer
772
views
Image Generator with a Neural Network (CIFAR-10)
As some of you may know, CIFAR-10 is a data base which has 60,000 images (which are 32x32 in size) of 10 different categories (airplane, dog, cat, frog, deer, bird, horse, ship, automobile and truck). ...
6
votes
1
answer
543
views
How do I generate SMILES using machine learning in Mathematica?
I am wondering if anyone has experience with generating molecules using machine learning in Mathematica. There are a bunch of papers these days with such applications/developments. For example, https:/...
- 739
6
votes
0
answers
287
views
Any competitive speech-to-text models?
SpeechRecognize is not very useful compared to most voice transcription engines nowadays, simply too fragile and prone to errors.
I use Otter.ai currently, is there anything competitive to that (or ...
- 3,830
6
votes
0
answers
238
views
How to perform feature selection for machine learning applications?
Feature selection is fairly easy in e.g. Python's scikit-learn which sports a module and tutorials or MATLAB.
Mathematica even touts that it uses feature selection ...
- 553
6
votes
0
answers
315
views
6
votes
0
answers
186
views
How can I prevent errors with ReplicateLayer[]?
I am trying to build a NetGraph[] that takes input of the form {{0.6},{0.6},...,{0.8},{0.8}} and multiplies the last sequence ...
- 1,447
6
votes
0
answers
118
views
How can one train a Neural Network in Mathematica such as to recognise and count all occurrences of a certain custom category in an image?
I'm trying to use Mathematica for the following task:
(1) Get an aereal view of a certain area in Mongolia
(2) Count the number of plots that contain houses, and the number of plots that contain ...
- 61
6
votes
0
answers
170
views
Export ImageCases to Python?
I’d like a tutorial on how to export a bounding box detector network to mxnet, (for bonus points: convert to Tensorflow), and then get it running correctly in python!
Some related questions exist for ...
- 31.8k
6
votes
0
answers
246
views
Can I use Mathematica ML capability to translate an image of a formula?
If I am given a pdf image of a mathematical symbolic formula can I translate it into Mathematica syntax using ML?
I tried using Classify, but I can only translate parts of the equation and I don't ...
- 517
6
votes
0
answers
367
views
How "good" is the new Classify and how does it choose its method
I recently read the blog regarding data-science Wolfram Blog and then checked the quality of the new Classify. I have a bunch of slides that I show to my students ...
- 5,623
6
votes
0
answers
126
views
What algorithm is BayesianMaximization using?
The docs show the following options for BayesianMaximization's Method:
"MaxExpectedImprovement" maximize expected improvement over current best value
"MaxImprovementProbability" maximize ...
- 3,830
6
votes
0
answers
173
views
Create ClassifierFunction
Is there a way to create my own ClassifierFunction? I would like to combine predictions from multiple independent classifiers into a single ensemble ClassifierFunction and be able to use things like ...
- 647
6
votes
0
answers
137
views
How can I change the distance function in Classify when using NearestNeighbor?
Issue not present in version "10.4.1 for Linux x86 (64-bit) (April 11, 2016)"
...
- 2,046
5
votes
0
answers
186
views
Target Device->"GPU" Not Working For Machine Learning: LibraryFunction error
I'm running Wolfram Desktop version 13.2.1, and after downloading Visual Studio, Nvidia Toolkit version 12.1 and 11.2, and verifying that
...
- 683
5
votes
0
answers
142
views
Derivation from a network
how can I represent the derivative of a network (e.g. NetGraph or NetChain) as a network? I have tried it with FunctionLayer[] and NetPortGradient, but without success.
I would be very pleased to ...
- 91
5
votes
0
answers
216
views
Modern topic modeling?
This question was asked in 2014: How to perform document classification (i.e. extracting topics from text)?
At the time user @V.E. gave a great little tutorial on LDA, but today, there's still no ...
- 31.8k
5
votes
0
answers
158
views
How to train each layer in a Neural Network so they optimize different loss functions in an adversarial network?
Example NetGraph to illustrate the idea (Input is an online signal with a value between -1 and 1, Noise is Gaussian Centered at 0 and standard deviation 0.1, EvilNet is constrained to output a value ...
- 526
5
votes
0
answers
241
views
Seq2Seq RNN with an AttentionLayer
In many Sequence to Sequence machine learning tasks, an Attention Mechanism is incorporated.
Before Transformer Networks, introduced in the paper: Attention Is All You Need, mainly RNNs were used to ...
- 428
5
votes
0
answers
167
views
Is there a way to get the decision trees used by machine learning methods like `RandomForest`?
I was looking at a tutorial of SimFin, a new German-based financial data provider.
There is a nice example of machine learning using sklearn in python. The package ...
- 9,751
5
votes
0
answers
292
views
Image-based reinforcement learning with neural networks
After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
- 406
5
votes
0
answers
105
views
Recognising people from photos
I have a large number (probably 10000) of personal photos taken over the last few years, a good proportion of which contain family members.
I'd like to put together a photo book of one family member,...
- 5,693
5
votes
0
answers
161
views
Reverse Engineering of MMA `Classify[]` Output?
Update: as @AntonAntoniv rightly noticed in his comment the case of DecisionTree is already discussed. Now it would be great to also have an equivalent answer for LogisticRegression.
MMA is really ...
- 2,493
5
votes
0
answers
145
views
Can I extract symbolic expression of neural network loss function?
Once we create a neural network with NetChain in Mathematica, can we extract the loss function in the symbolic form for Mathematica to play with symbolic manipulations using Mathematica's built-in ...
- 1,249
5
votes
0
answers
66
views
How to make the clustering result of version 11.2 and 11.3 same?
I was doing clustering analysis in version 11.2, with codes like below, and then got 12 clusters as the output:
...
- 3,509
5
votes
0
answers
167
views
How to explain overfitting?
SeedRandom[0];
X = RandomInteger[{1, 5000}, {100000, 50}];
Y = RandomInteger[{0, 1}, 100000];
For net1 and ...
- 9,621
5
votes
0
answers
157
views
What's BayesianMinimization and related functions based on?
Is it specified anywhere what the backend is for the Bayesian optimization related functionality in Mathematica v11? I'm specifically referring to the Bayesian* ...
- 1,002
5
votes
0
answers
174
views
How to train further in Predict?
Training further means we can get much smaller loss in the training set,and maybe get the smaller loss in the validation set,so this is useful.
For example
...
- 6,866
5
votes
0
answers
276
views
Is Mathematica a good choice for a scientific project with Machine Learning?
I'm a chemist with some rudimentary programming skills and in the middle of the year I'll be starting a project concerning machine learning, so, I'm sorry if I'm going to ask two questions in this ...
- 193
5
votes
0
answers
491
views
How to train a visual attention model?
In version 11.1 there is a new layer type SequenceAttentionLayer[]. I'm interested in how might this be used to train a recurrent visual attention model (see the ...
- 31.8k
5
votes
0
answers
99
views
How to use PredictorMeasurements without a PredictorFunction?
I have the output and target values computed already from a model applied a test set, but it's not a PredictorFunction. Is there any way to force feed these to <...
- 31.8k
5
votes
0
answers
487
views
Softmax Regression Classification Algorithm
I'm following the Stanford Machine Learning course while simultaneously developing my Mathematica abilities. I'm having issues with my Softmax Classifier implementation (for ref, have a look at these ...
4
votes
0
answers
127
views
General hyperparameter searching?
I typically use naive random or grid search to choose them, but I'd like to ask if there are built-in or paclet-based methods that can help perform more principled general hyperparameter searches?
For ...
- 3,830
4
votes
0
answers
90
views
Exporting a DimensionReducerFunction
I need to run my DimensionReducerFunction in a standalone fashion outside of MMA. That is, without calling into a kernel or through an APIFunction.
For example, ...
- 31.8k
4
votes
0
answers
168
views
Probem of Classify's Tree Method in Batch Predict
$Version
12.1.0 for Microsoft Windows (64-bit) (March 14, 2020)
...
- 8,649
4
votes
0
answers
133
views
Neural network for a simple game?
I'm taking a class that is based on the Mathematica coding language, and we must do a 6-week final project. I am considering coding a neural network for a simple game like 2048, pacman, snake, etc. ...
4
votes
0
answers
124
views
How to get features for captioned images?
I have a lots of (image, text) pairs and would like to learn a feature extractor (or maybe a FeatureExtractorFunction) for a combined embedding.
It seems that when given a list of these multimodal ...
- 31.8k
4
votes
0
answers
383
views
Visualizing and Understanding CNN with Mathematica
The famous 2013 paper from Zeiler and Fergus "Visualizing and Understanding Convolutional Networks" proposes a method to understand the behavior of CNN using one (or more) DeConv networks coupled with ...
- 383