All Questions
Tagged with predictor or machine-learning
682 questions
14
votes
1
answer
918
views
Neural machine translation model using deep learning
In Mathematica version 11.1, SequenceAttentionLayer is introduced to model attentions in the recurrent neural network. It has been shown that attention mechanism ...
- 27.8k
14
votes
1
answer
302
views
WLNet format incompatible between version 11.0 and 11.1
It seems that there are some behavior changes of neural network layers from version 11.0 to 11.1 that leads to the incompatibility of WLNet format.
Consider this example:
Network exported in 11.0
<...
- 27.8k
14
votes
1
answer
2k
views
Is there any decent deep learning library in Mathematica?
Deep Learning is the currently trending method in machine learning community. Some languages like python and matlab have some very convenient toolbox for deep learning. So is there any decent deep ...
- 1,582
14
votes
1
answer
2k
views
M1 Apple silicon ML performance
Testing out a new M1 Macbook pro with Mathematica 13.0.0. I verified that I used the correct version and it is running natively on ARM.
Mathematica in general runs great, and much fast than on my ...
- 141
14
votes
0
answers
604
views
How to plug holes in an Image (with partial convolutions)?
NVIDIA recently published a new way to reconstruct images with holes. They use a new type of convolutional layer which is described in the paper Image Inpainting for Irregular Holes Using
Partial ...
- 3,830
14
votes
0
answers
1k
views
Neural network playground [closed]
I came across this Neural Net Playground demonstration based on Google's Tensorflow package. It visualizes the data processing inside a neural network and allows you to tweak parameters and ...
- 31.8k
13
votes
2
answers
2k
views
How to change NeuralNetwork options?
How can I manipulate the architecture and problems of a NeuralNetwork in Predict or Classify? For example, running the following ...
- 968
13
votes
2
answers
480
views
Classify / Predict: ensemble of classifiers / predictors
Mathematica has undocumented functionality of combination classifiers / predictors in ensemble. How to get access to this functionality?
SeedRandom[1];
X = Table[
Join[
ToString /@ RandomReal[{...
- 9,621
13
votes
2
answers
1k
views
t-SNE visualization
Is there an implementation of “t-SNE” for dimension reduction in mma? This technique visualizes high-dimensional data by giving each
datapoint location in a two or three-dimensional map. It generally ...
- 31.8k
13
votes
2
answers
3k
views
How to train a convolutional neural net on images?
The functions Predict[] and Classify[] both have the option Method -> "NeuralNetwork", ...
- 31.8k
13
votes
2
answers
1k
views
Implementing a Neural Network
TLDR: I am implementing a neural net in Mathematica and need help with back propagation.
This is purely for the joy of implementing a neural network with a functional programming language. If someone ...
- 357
13
votes
2
answers
790
views
How to implement a triplet network with NetSharedArray?
In v11.3, NetSharedArray[] and NetInsertSharedArray[] give us a mechanism of sharing weights and biases across neural networks, ...
- 31.8k
13
votes
1
answer
1k
views
How to implement QLearning?
I know that v10 has support for both Machine Learning and Finite Markov Processes, the Q-learning algorithm uses both. Specifically, Q-learning finds an optimal action-selection policy for any given (...
- 31.8k
13
votes
1
answer
618
views
Wolfram Neural Net Repository Questions
I was a research scientist in the machine learning team, and mostly involved with the neural net repository.
- 131
13
votes
1
answer
9k
views
How can image segmentation from UNET be improved?
EDIT 2: code can be found @ https://github.com/alihashmiii/UNet-Segmentation-Wolfram
EDIT 1: applying Binarize to the masks after resizing helps to ensure the data for mask is binary
I have made an ...
- 9,060
13
votes
2
answers
524
views
Simple example of NetGraph running in MXNet?
There is an great example of exporting a NetGraph (that was trained in Mathematica) into the MXNet's format.
However, I think there's a bug or something is wrong with the answer, because once ...
- 3,830
13
votes
0
answers
608
views
Trying to build a code to translate handwritten formulas using ML
I'm lazy writing equations in Latex so I want a code to translate handwritten equations. This question is related to an old experiment I'm reviewing during vacations, here. I'm trying to use ...
- 517
12
votes
4
answers
2k
views
Text recognition - extracting table of text from image
I want to extract table from the image bellow as a list of strings. I tried the following but it does not work.
...
- 25.1k
12
votes
2
answers
864
views
How to inspect the learned ClassifierFunction decision tree model?
Assume I have a ClassifierFunction object learned like this:
classifier = Classify[trainSet, Method -> "DecisionTree"]
...
- 797
12
votes
3
answers
775
views
How to make Advanced Activations Layers in Mathematica?
I want to try Advanced Activations Layers in Mathematica,but not found.
So I try to use ElementwiseLayer to implement it.
...
- 6,866
12
votes
1
answer
462
views
How to monitor the progress of training a classifier?
I've had p = Predict[x -> y] running for hours and I have now idea if I should kill it or not.
I'm looking for some rough bounds for an estimate of how long <...
- 31.8k
12
votes
1
answer
1k
views
Configuring GPU for NetTrain
I currently have access to a system with two GPUs:
GeForce GTX 1080 and Tesla K40c
I would like to use this machine for training neural networks in Mathematica.
When using the option ...
- 1,410
12
votes
1
answer
391
views
Can Predict/Classify be parallelized?
Being able to parallelize Predict /Classify would be useful on multiple fronts:
Performance/Scale
Streaming
Pedagogical
...
- 6,086
12
votes
1
answer
974
views
Same neural network gives different results
I was playing with the neural network in Mathematica and found that the same neural network gives different classification results to the same image, which is very strange.
Consider classifying this ...
- 27.8k
12
votes
1
answer
422
views
How to determine which Layers should be used in my NetChain?
I have a answer in this post which is based on neural network,but I have to say that reault is too bad and have no practicability.I think the reason is that selection of network layers.So I give some ...
- 27.2k
11
votes
3
answers
2k
views
Noise filtering in images with PCA
I have a stack of images (usually ca 100) of the same sample. The images have intrinsic variation of the sample, which is my signal, and a lot of statistical noise. I did a principal components ...
- 399
11
votes
1
answer
724
views
Deep learning outperforms in symbolic integration and ODE?
There comes a new paper on arXiv (arXiv 1912.01412, Deep Learning for Symbolic Mathematics by
Guillaume Lample, François Charton) claiming that a deep learning model outperforms Mathematica a lot in ...
- 4,758
11
votes
3
answers
994
views
Using Mathematica wlnet model in C++
Suppose if there is a trained net:
SeedRandom[1234];
net = NetInitialize@NetChain[{5, 3}, "Input" -> 2];
It can predict image in mma:
...
- 6,866
11
votes
1
answer
2k
views
Markov Random Field
I look for an efficient way to implement a Pairwise Markov Random Field.
I have implemented a homogeneous (i.e., unary potential is a similar function in all nodes, and pairwise potential is a ...
- 2,019
11
votes
1
answer
841
views
How to perform UMAP dimensionality reduction?
This new method UMAP looks to be better than TSNE, unfortunately it is not available as a dimension reduction method yet:
Does anyone know if there exists an implementation of it in, or accessible ...
- 3,830
11
votes
1
answer
358
views
Apply Result of NetTrain using GPU?
I'v trained a deep network (e.g. LeNet) using NetTrain with TargetDevice -> "GPU". Everything works well and it is really fast. But now I have a trained network and tens of thousands of samples to ...
- 647
11
votes
1
answer
394
views
NetEncoder for images of "Varying" dimension?
I'm looking for someway to do what this syntax "should" do:
NetEncoder[{"Image", Automatic, ColorSpace -> "RGB"}] /@ imgs;
The documentation states that ...
- 31.8k
11
votes
2
answers
703
views
How to combine Neural Network and Audio like Classify?
I want to combine Audio object and Neural Network ,first thing I remember is Classify
...
- 6,866
11
votes
1
answer
581
views
11
votes
1
answer
406
views
How to view ClassifierFunction's preprocessed data?
Classify apparently preprocesses your input data, for example (same example from Classify reference page, but using ...
- 360
11
votes
1
answer
870
views
How to use an external GPU to train neural networks in Mathematica?
Taking steps in the uncharted territories of eGPUs, I have installed an NVIDIA GeForce Titan Xp GPU on an eGPU enclosure (Mantiz MZ-02) and have connected it to my laptop (HP Spectre x360 - 15-bl075nr ...
- 1,883
11
votes
1
answer
233
views
Help: Reclassify
Is it possible to improve the current ClassifierFunction with more training data without running the previous training again?
In this way i will be able to deal ...
- 9,751
11
votes
1
answer
1k
views
Neural Networks in Predict function
I'm trying to reproduce the result giving by a Predict function with a Neural Network as the chosen method.
So, I'm training from this set:
...
- 981
11
votes
1
answer
490
views
Can LearnDistribution learn conditionality?
I would like to apply LearnDistribution to multivariate conditional distributions. Here's a simple artificial example:
...
- 31.8k
11
votes
0
answers
235
views
Tutorial example NetTrain fails miserably with a GPU
I have been experimenting with GPU NetTrain on AWS now when Mma 12.2 supports remote batch jobs (I don't have an Nvidia GPU to try these things out otherwise). In ...
- 19.1k
10
votes
1
answer
2k
views
How can I determine the importance of variables from Classify?
I have used the "RandomForest" method in Classify to classify my response variable (nominal with 2 levels). Can Classify, like ...
- 899
10
votes
1
answer
480
views
Can we implement a Neural Network interactively?
Implementing a Neural Network manually need some code and need to make some connections between these components.
Can we implementing a Neural Network interactively?If I want to make a net like ...
- 6,866
10
votes
1
answer
380
views
Labeling images for TrainImageContentDetector
I want to use TrainImageContentDetector on a directory of ~2k unlabeled images. I'm willing to put in the effort to label them, but I was never good at using "...
- 3,830
10
votes
2
answers
427
views
Mathematica 11.1 - Issue with Training Function for Sequence Data
I am attempting to use the new recurrent network functionality in Mathematica 11.1 Home Edition. I created a network that will attempt to predict future bytes in a raw audio file (using very small ...
- 103
10
votes
1
answer
182
views
Wha't the meaning of NaN in the descriptor of ImageKeypoints
Bug introduced in 10.3 or earlier and persisting through 11.3
...
- 8,649
10
votes
1
answer
556
views
NetTrain an image caption generator
I would like to write out the simplest possible word-by-word image caption generator. This network should take an image and build a sentence describing it.
Here is my fashion dataset of images and ...
- 3,830
10
votes
1
answer
372
views
How does mathematica compute loss with multi-losses?
I want to make a DNN that it can learn from text feature(1534-dims) and old audio features(256*4(four old frames)-dims) to predict audio feature(256-dims) at current frame.
So it has two inputs,one ...
- 6,866
10
votes
1
answer
269
views
Can one use NetTrain with two Nvidia GPUs?
I am thinking of buying another GPU to accelerate my training. Will I be able to call NetTrain with both GPUs ("TargetDevice"-> {"GPU", All})? Or would it be ...
- 1,535
10
votes
1
answer
735
views
Mathematica learning resource dealing with bayesian inference
Is there any good resource dealing with both Mathematica and bayesian inference?
- 1,582
10
votes
0
answers
786
views
How to train a bounding box detection model?
Apparently, this still isn't possible in v12?
I'd like to add a new class to one of the standard object detection architectures. Consider the YOLO v2 detector from the Neural Net Repo.
...
- 31.8k