All Questions
Tagged with predictor or machine-learning
682 questions
6
votes
0
answers
126
views
What algorithm is BayesianMaximization using?
The docs show the following options for BayesianMaximization's Method:
"MaxExpectedImprovement" maximize expected improvement over current best value
"MaxImprovementProbability" maximize ...
- 3,820
6
votes
0
answers
173
views
Create ClassifierFunction
Is there a way to create my own ClassifierFunction? I would like to combine predictions from multiple independent classifiers into a single ensemble ClassifierFunction and be able to use things like ...
- 647
6
votes
0
answers
137
views
How can I change the distance function in Classify when using NearestNeighbor?
Issue not present in version "10.4.1 for Linux x86 (64-bit) (April 11, 2016)"
...
- 2,046
6
votes
0
answers
343
views
How to perform Bayesian optimization with Mathematica? [duplicate]
Does Mathematica have any Bayesian optimization methods for learning hyper-parameters?
Practical Bayesian Optimization of Machine Learning Algorithms
Jasper Snoek, Hugo Larochelle and Ryan P. ...
- 31.8k
5
votes
1
answer
511
views
How to build a NetChain by the information of ClassifierFunction?
NetChain provides a method NetExtract.
I want to see how standClassify = Classify[trainingData, Method -> "NeuralNetwork"] works,beacause it has a better ...
- 449
5
votes
2
answers
200
views
SoftmaxLayer Incompatible types
Trying to create U-Net similar to this paper from this GitHub project but keep getting "incompatible type" error on the final softmax layer. Any ideas for how to organize data to satisfy Softmax layer?...
- 647
5
votes
1
answer
1k
views
How to generate names with a GAN?
I'd like a tutorial for text generation using GANs, specifically for names. I have a list of company names and would like the network to generate novel ones.
This is one of the only few examples of ...
- 3,820
5
votes
1
answer
332
views
How can I plot this one-dimensional Self Organizing (Kohonen) Map?
Mathematica used to have a package called NeuralNetworks that is not currently working. With that package, you could create a Kohonen or Self Organizing Map (https://en.wikipedia.org/wiki/Self-...
5
votes
1
answer
276
views
Using AI to get the geographic locations of a list of banks
I have a list of banks from Bloomberg, and am looking to locate them on the world map,
...
- 2,223
5
votes
1
answer
225
views
Single Neuron Dream Example (from Markus van Almsick's Presentation WTC 2017)
I'm teaching myself about Mathematica 11.3 Neural Net capabilities, and I can't get a demonstrably previously working example to work. I've been trying for quite a while without success.
In Markus ...
- 4,839
5
votes
2
answers
212
views
Inexplicable results from ClusteringComponents Agglomerate in version 11.1
I have data like this:
data = {5, 12, 18, 19, 20, 23, 24, 26};
On Mathematica 11.1, clustering produces a variable final choice of clusters. For example:
...
- 1,146
5
votes
1
answer
311
views
Using a classification Neural Net and parameter to ClassifierMeasurements[]
I created and trained a simple neural net, which takes some inputs and produces a 3-class classification. Then I feed it to CM[] function with some test data, and... nothing. Haven't been successful ...
- 1,370
5
votes
1
answer
352
views
Updated: Correct Formatting of Dataset (labeled columns and rows) for Predict v NetTrain?
Problem
I can not seem to figure out the correct way of formatting Dataset to be used with predict. I am providing Mathematica's example, which works fine. I also am including an abitrary "dataset" ...
- 5,442
5
votes
1
answer
196
views
Sort symbols or characters by image complexity
As an example, I would like to sort the following characters by some sort of complexity measure:
...
- 6,027
5
votes
2
answers
101
views
Which model behind SequencePredictorFunction?
Is the SequencePredictorFunction based on Hidden Markov Model?
If so, how does the model estimate the number of hidden states?
5
votes
1
answer
324
views
How to cluster a set of images?
I have a set of images (imgset) as
Clearly, the classification list should be
...
- 3,405
5
votes
1
answer
461
views
Response of Dynamic is slow
I wrote the following code to make an interactive GUI for Mathematica's Neural Network example of
Digit Classification
Here is the Code
...
- 77
5
votes
1
answer
118
views
Why would a symmetric image have an asymmetric PoolingLayer-Gradient Image?
I have a symmetric image img. For simplicity, I would use the below image as my example:
...
- 3,509
5
votes
1
answer
269
views
Custom Loss Layer to ignore ordering
I am trying to train a net that takes a sequence of numbers and gives a sequence of numbers. For example:
...
- 1,535
5
votes
2
answers
287
views
How to make similar objects have similar embedding weights?
In the read world, there are many many phones(aa ae ah ao ar aw ax ay b ch d dh ...).
But for brief,I only use three phones(aa ah ae) to illustrate my question.And it only need training Data,no Test ...
- 6,866
5
votes
2
answers
2k
views
Vector-valued output from Predict
I have a list of 3D points, and I'd like to run a Predict on them just to test. It should be fairly straightforward. Here's a simple example:
...
- 341
5
votes
1
answer
198
views
Does Mathematica have a LogSumExp function that's numerically stable?
I searched "Mathematica LogSumExp", and literally nothing is coming up. It's a relatively important function in machine learning and for numerically stable computation. Will I just have to ...
- 191
5
votes
1
answer
515
views
Loss function with regularization
The ML framework has a limited set of loss functions available. How can I extend this by creating my own custom ones?
For example, for L2-regularized training, Mathematica recommends
...
- 727
5
votes
1
answer
135
views
How to avoid crashing with ConformImages?
ConformImages[] is causing a kernel crash when applied to a list of 5k images. Is there any way to apply ConformImages on the list in batches or asynchronously to ...
- 31.8k
5
votes
1
answer
670
views
How can I train a binary classifier to find a logo?
So I'm trying to contruct a simple binary classifier.
Problem: Classify an image as containing the apple logo, or not.
I'd like it to be distortion, color, size and rotationally invariant. I'm sure ...
- 31.8k
5
votes
1
answer
440
views
How to paraphrase text?
I'm looking to train or use pre-trained models in order to re-phrase text. Are there any natural language models in the Wolfram Neural Repository (or elsewhere) that can be used to paraphrase text?
...
- 3,820
5
votes
1
answer
289
views
Error during training neural network: input is not an integer between 1 and 100 although it is
I imported my data from Matlab in matrix form and tried to use it in a neural network as given below but I get the error that says the input is not an integer between 1 and 100 although it is.
<...
- 75
5
votes
1
answer
337
views
ClusteringComponent and FindClusters are returning the wrong number of clusters and are inconsistent
I am trying to find the optimum number of clusters in a correlation matrix.
To do this I run a clustering algorithm that loops through 3 variables ( number of clusters, ...
5
votes
1
answer
410
views
Predict on Raspberry Pi is incredibly slow or simply hangs
I'm testing the latest Mathematica available on the Raspberry Pi (10.3.1 for Linux ARM (32-bit) (January 11, 2016)) for machine learning but I'm having issues with the default behaviour of Predict.
...
- 253
5
votes
1
answer
1k
views
How to perform convolutions on this complicated pdf?
For a known pdf f[x], I need to calculate integrals over the probability density of the sum of Log[f[x]] over independent samples:
$$Q[t,n]\equiv P(\sum_{i=1}^{n}...
- 4,642
5
votes
1
answer
376
views
Predict expand training data
Disclaimer: I have edited this question to provide my MWE, since it seems, I have a very similar question. -- LLlAMnYP 21.03.2018
Lets say I have a small set of training data and have calculated a ...
- 520
5
votes
1
answer
269
views
How to write a RCNN (region-cnn)?
Has anyone end-to-end trained a single net that can find the location of objects in an image (with v11.1)? Here's an example of a region-cnn in action, and this is a good description of the approach.
- 31.8k
5
votes
0
answers
186
views
Target Device->"GPU" Not Working For Machine Learning: LibraryFunction error
I'm running Wolfram Desktop version 13.2.1, and after downloading Visual Studio, Nvidia Toolkit version 12.1 and 11.2, and verifying that
...
- 683
5
votes
0
answers
142
views
Derivation from a network
how can I represent the derivative of a network (e.g. NetGraph or NetChain) as a network? I have tried it with FunctionLayer[] and NetPortGradient, but without success.
I would be very pleased to ...
- 91
5
votes
0
answers
216
views
Modern topic modeling?
This question was asked in 2014: How to perform document classification (i.e. extracting topics from text)?
At the time user @V.E. gave a great little tutorial on LDA, but today, there's still no ...
- 31.8k
5
votes
0
answers
158
views
How to train each layer in a Neural Network so they optimize different loss functions in an adversarial network?
Example NetGraph to illustrate the idea (Input is an online signal with a value between -1 and 1, Noise is Gaussian Centered at 0 and standard deviation 0.1, EvilNet is constrained to output a value ...
- 526
5
votes
0
answers
241
views
Seq2Seq RNN with an AttentionLayer
In many Sequence to Sequence machine learning tasks, an Attention Mechanism is incorporated.
Before Transformer Networks, introduced in the paper: Attention Is All You Need, mainly RNNs were used to ...
- 428
5
votes
0
answers
167
views
Is there a way to get the decision trees used by machine learning methods like `RandomForest`?
I was looking at a tutorial of SimFin, a new German-based financial data provider.
There is a nice example of machine learning using sklearn in python. The package ...
- 9,751
5
votes
0
answers
292
views
Image-based reinforcement learning with neural networks
After seeing that "OpenAIGym" is not exactly supported on Windows and playing around with https://www.wolfram.com/language/12/neural-network-framework/train-an-...
- 406
5
votes
0
answers
105
views
Recognising people from photos
I have a large number (probably 10000) of personal photos taken over the last few years, a good proportion of which contain family members.
I'd like to put together a photo book of one family member,...
- 5,693
5
votes
0
answers
161
views
Reverse Engineering of MMA `Classify[]` Output?
Update: as @AntonAntoniv rightly noticed in his comment the case of DecisionTree is already discussed. Now it would be great to also have an equivalent answer for LogisticRegression.
MMA is really ...
- 2,493
5
votes
0
answers
145
views
Can I extract symbolic expression of neural network loss function?
Once we create a neural network with NetChain in Mathematica, can we extract the loss function in the symbolic form for Mathematica to play with symbolic manipulations using Mathematica's built-in ...
- 1,249
5
votes
0
answers
66
views
How to make the clustering result of version 11.2 and 11.3 same?
I was doing clustering analysis in version 11.2, with codes like below, and then got 12 clusters as the output:
...
- 3,509
5
votes
0
answers
167
views
How to explain overfitting?
SeedRandom[0];
X = RandomInteger[{1, 5000}, {100000, 50}];
Y = RandomInteger[{0, 1}, 100000];
For net1 and ...
- 9,621
5
votes
0
answers
157
views
What's BayesianMinimization and related functions based on?
Is it specified anywhere what the backend is for the Bayesian optimization related functionality in Mathematica v11? I'm specifically referring to the Bayesian* ...
- 1,002
5
votes
0
answers
174
views
How to train further in Predict?
Training further means we can get much smaller loss in the training set,and maybe get the smaller loss in the validation set,so this is useful.
For example
...
- 6,866
5
votes
0
answers
185
views
GPU Acceleration and the Predict function [duplicate]
With the Mathematica Predict function, does it automatically use GPU acceleration? For example, with NetTrain, one has to specify TargetDevice->"GPU" to show they want to perform the calculation on ...
- 1,447
5
votes
0
answers
276
views
Is Mathematica a good choice for a scientific project with Machine Learning?
I'm a chemist with some rudimentary programming skills and in the middle of the year I'll be starting a project concerning machine learning, so, I'm sorry if I'm going to ask two questions in this ...
- 193
5
votes
0
answers
491
views
How to train a visual attention model?
In version 11.1 there is a new layer type SequenceAttentionLayer[]. I'm interested in how might this be used to train a recurrent visual attention model (see the ...
- 31.8k
5
votes
0
answers
99
views
How to use PredictorMeasurements without a PredictorFunction?
I have the output and target values computed already from a model applied a test set, but it's not a PredictorFunction. Is there any way to force feed these to <...
- 31.8k