Questions tagged [machine-learning]
Questions about machine learning functionality of Mathematica, for instance involving, but not restricted to, Predict, Classify, FindClusters and the various regression functions.
471
questions
0
votes
1answer
115 views
Realization machine learning [closed]
Can you advise me what kind of machine learning to achieve? ... I had thought, for example, to make a face and, by varying the expression through the "manipulate" function (I do not know if it is ...
4
votes
1answer
117 views
Speedup of DimensionReduce
I am interested in accelerating DimensionReduce using the "TSNE" method. I have a matrix with a size of 30000 * 10, and I want to reduce to 30000 * 8. But the calculation is very slow, any suggestions ...
7
votes
1answer
122 views
Machine learning: How to fix part of the weight matrix?
Consider a linear layer with 2*2 weights
linear = LinearLayer[2, "Input" -> 2];
net = NetInitialize[linear];
After the initialization, the four elements of ...
4
votes
0answers
61 views
Candidate sampling for softmax neural networks in mathematica
Though I've been using mathematica for a few years, I've never really delved into its ML capabilities (except for the occasional clustering). I'm curious if anyone who has some experience using ...
1
vote
0answers
62 views
How to parse through a .txt file in the Classify function and assign a class to each item?
I have 2 txt files that contain 500 DNA sequences each. Both files use 2 hard returns to separate the sequences like so:
ATCGATCT...
ATCGATCT...
ATCGATCT...
I ...
7
votes
1answer
166 views
NetPortGradient output port restriction
The documentation for NetPortGradient says
net[<|..., NetPortGradient[oport] -> ograd|>, NetPortGradient[iport]] can ...
3
votes
0answers
124 views
Backpropagation for manual neural network training [duplicate]
I need to train a neural network manually. Is there a simple way to get the derivatives of all of the learned parameters in the network (with respect to the output) via backpropagation, other than ...
1
vote
0answers
87 views
How to use UnitVectorLayer in a NetChain?
How can I create a NetChain with UnitVectorLayer inside?
In this way I receive this error:
...
0
votes
0answers
51 views
CDF of probability from a ClassifierFunction
I have a classifier function that classifies whether a student is likely to succeed in a course given their score on a placement test. From this, I am pulling both the probability of being successful ...
3
votes
1answer
102 views
10
votes
1answer
146 views
Wha't the meaning of NaN in the descriptor of ImageKeypoints
Bug introduced in 10.3 or earlier and persisting through 11.3
...
3
votes
1answer
146 views
How to use FastText embeddings in a NetGraph?
Does Mathematica 11 have access with either the Wikipedia or CommonCrawl FastText embeddings? Maybe this is built-in through the Neural Net Repository or available through a ...
0
votes
0answers
102 views
Using machine learning to find correlation between data
I've taken several months worth of data on health(water intake, activity, steps, sleep quality, heart rate, etc.) and I would like to use Mathematica to find correlations within the data. I would like ...
4
votes
2answers
106 views
Crashes of Classify function
I'm working on a classifying two classes. I am training my Classify function with the RandomForest method, but it crashes.
The ...
4
votes
0answers
94 views
Capsule Network reconstruction layer
I am experimenting the capsule network, using the architecture provided here:
Capsule Network in Mathematica Deep Neural Network Repository
While I can figure out what the network do following the ...
5
votes
1answer
82 views
ClusteringComponent and FindClusters are returning the wrong number of clusters and are inconsistent
I am trying to find the optimum number of clusters in a correlation matrix.
To do this I run a clustering algorithm that loops through 3 variables ( number of clusters, ...
7
votes
2answers
164 views
How to Classify with LogisticRegression with a non linear border?
I am currently taking the Coursera Machine Learning course and want to reproduce some of the coding exercises in Mathematica.
In Exercise 2 the problem is to Classify with Logistic Regression. So I ...
8
votes
2answers
121 views
Kernel shut down when use FindFaces with LBP Cascades
I found Mathematica can use OpenCV to improve face recognition in FindFaces: how to improve the results of the face recognition feature.
But I tried this way and the kernel crashed.
...
3
votes
0answers
105 views
Implementing Mathematica Machine Learning Algorithm in an HTML-Web Page
I have a Mathematica Neural Network developed in Mathematica 11.2 that I'd like to upload and use on my website. The algorithm takes in images as an input. My website is built with HTML-CSS and Flask. ...
3
votes
1answer
42 views
How does NetDecoder for Tokens work?
I'm trying to understand why I can decode encoded word tokens?
...
10
votes
1answer
375 views
NetTrain an image caption generator
I would like to write out the simplest possible word-by-word image caption generator. This network should take an image and build a sentence describing it.
Here is my fashion dataset of images and ...
15
votes
1answer
420 views
Training Neural Networks on Cloud GPUs (Wolfram Cloud / AWS / Paperspace /etc)
I have spent a lot of time lately training neural networks. However, my poor laptop has only an AMD GPU, so I am stuck training these networks on the CPU. That means I get to train networks over ...
9
votes
2answers
270 views
How to inspect the learned ClassifierFunction decision tree model?
Assume I have a ClassifierFunction object learned like this:
classifier = Classify[trainSet, Method -> "DecisionTree"]
...
3
votes
1answer
139 views
How to modify NetTrain's error calculation
I'm training a neural network at the moment on an image segmentation problem (that is, I have an images and masks, and I am trying to train the network to generate its own masks from other images.
I'...
9
votes
0answers
338 views
How to perform UMAP dimensionality reduction?
This new method UMAP looks to be better than TSNE, unfortunately it is not available as a dimension reduction method yet:
Does anyone know if there exists an implementation of it in, or accessible ...
8
votes
2answers
273 views
How to recreate this 3D plot?
In other languages, one can make a FeaturePlot3D-esque graphics where the inset images look realistically three dimensional. Meaning that they are smaller when farther away (and also hazier).
So how ...
1
vote
0answers
36 views
How to ask FindClusters to return the loss function value in the output?
I have some data points pts as below:-
pts = BlockRandom[SeedRandom[123]; RandomReal[1, {100, 2}]];
Now I want to separate ...
0
votes
0answers
30 views
How to change the formulae of FeatureExtraction?
I have a feature extraction function fe, which gives me n/0.816497 as the output of fe[{1}]:-
...
7
votes
1answer
375 views
Why is SVM unable to separate linearly separable data?
I have two sets of data, namely blue and yellow. I manually added a point {8, -3} to the blue data.
...
3
votes
1answer
99 views
How to reconstruct the result of FeatureExtraction?
For the below code for Mathematica 11.3, I got {-0.153792, 1., 1.} as output.
...
0
votes
1answer
88 views
Problem of Low Accuracy of NeuralNetwork Method in Classify MNIST 11.3
The accuracy is extremely low... even after changing a lot of options of Method...
Other methods' result is fine and normal, 0.80 accuracy like LogisticRegression.
...
4
votes
1answer
129 views
Value for output of layer is inconsistent (implementing SqueezeUNET from Keras)
I'm attempting to implement this neural network in WL: https://github.com/lhelontra/squeeze-unet/blob/master/squeezeunet.py which is a variant of the SqueezeNet network that does image segmentation.
...
2
votes
0answers
77 views
Why is the output of the Embedding layer so non-linear?
I have 2 nets, i.e. net1 (i.e. LinearLayer) and net2 (i.e. ...
2
votes
1answer
112 views
How to generate a training set in an automatic way?
This question is related to my previous item where arithmetic with machine learning was considered. The results of the Predict command were not good because of a ...
2
votes
1answer
86 views
Custom NetEncoder
I've been trying to train an RNN on some data that I pre-processed externally and saved to disk. My dataset is too large to fit in memory and is additionally varying in shape.
Looking for a way to do ...
1
vote
0answers
81 views
Why Method -> “NeuralNetwork” does not work for me? [closed]
Mastering my Machine Learning, I try arithmetic:
...
5
votes
1answer
94 views
Why would a symmetric image have an asymmetric PoolingLayer-Gradient Image?
I have a symmetric image img. For simplicity, I would use the below image as my example:
...
4
votes
0answers
84 views
In neural network, how to force the NetTrain to use full batch gradient descent instead SGD?
In a neural network, I want to use full batch gradient descent instead of SGD. Currently, I am using code like this (you can see that I forced BatchSize to be the ...
6
votes
1answer
80 views
Which, if any, external machine learning libraries are used by Predict[]?
It's pretty much all in the title -- I suspect that Wolfram uses some standard (perhaps open-source) libraries in their machine learning functions, and I am curious as to what they are.
I am ...
4
votes
1answer
111 views
How to apply the layer of sigmoid function in neural network?
I saw an article How to build a simple neural network in 9 lines of Python code and want to reconstruct the result in Mathematica. I tried the below codes:-
...
7
votes
1answer
113 views
Regarding Gaussian Process in Predict function
The following code is exactly copied from the documentation on Predict using Gaussian Process.
...
3
votes
1answer
84 views
How to NetTrain only N batches?
I'd like to train a neural network for only a specified number of batches, that is for only part of an epoch (or TrainingRound). I've tried using the ...
4
votes
1answer
73 views
Predict[] Application Timing [closed]
I trained a Predict and when I look at PredictorInformation it says evaluation time is less than 1 millisecond per example. ...
3
votes
1answer
132 views
Extract neural network model from ClassifierFunction
I'm very new to Neural Networks and Mathematica 11 (I used MMA8 some time ago) and I'm trying to learn about NN using Mathematica. I'm using MMA 11.2 in a Rapsberry Pi (yes, I know that doing NN in a ...
2
votes
1answer
101 views
What does NetMapOperator do?
Recently, I have become addicted to Mathematica's support for neural networks. As I learn those commands that are prefixed with "Net", I can't tell the difference between using ...
2
votes
0answers
99 views
Does Mathematica auto update something causes error load old-version model?
I've trained a NN model by NetTrain with Mathematica 11.3.0, and I can load the model correctly to predict.
My model is saved by .mx format.
After few months, I cann't load the model correctly.
...
5
votes
0answers
60 views
How to make the clustering result of version 11.2 and 11.3 same?
I was doing clustering analysis in version 11.2, with codes like below, and then got 12 clusters as the output:
...
4
votes
1answer
104 views
Deep Learning SummationLayer does not support varying dimensions on Linux server
I am trying a recurrent network in Linux server using MMA 11.3. The network structure is as follows:
...
4
votes
0answers
108 views
How to explain overfitting?
SeedRandom[0];
X = RandomInteger[{1, 5000}, {100000, 50}];
Y = RandomInteger[{0, 1}, 100000];
For net1 and ...
1
vote
1answer
66 views
How can I see the predictor function that Mathematica produces?
I am trying some basic machine learning with Mathematica. I am wondering if I can see the function that Mathematica produces for a training set. I give the following example:
trainingset = {1 -> 1.3, ...
