Questions tagged [neural-networks]
Questions involving defining, training, executing, importing and exporting neural networks.
1
vote
0answers
32 views
How to use BERT for embeddings?
Does anyone know of a way to get the BERT model working for word embeddings in Mathematica? Doesn’t seem to be available on GitHub or the Wolfram Net Repo...
1
vote
1answer
24 views
Error NetTrain::invencin: Invalid input when training a neural network [on hold]
I've build a Deep neural network with various variables:
...
8
votes
1answer
106 views
How do I implement masked Softmax?
Consider:
input = {1, 2, 3};
mask = {1, 0, 1}
Classic Softmax:
SoftmaxLayer[]@input
{0.0900306, 0.244728, 0.665241}
...
2
votes
1answer
39 views
How to Provide an RNN various type of inputs?
I'm trying to build an RNN in Mathematica.
My window is only 2 but the variables are of different types:
...
4
votes
0answers
32 views
How to implement external memory for the “memory augmented neural network”?
I am trying to implement the memory-augmented neural network using MMA 11.3.
The memory-augmented neural network in based on the paper here. There are implementations using ...
0
votes
0answers
61 views
Robust face detection
FindFaces doesn't work when people are far away from the camera. I'm looking for a single accurate method of detecting one or more people in an images, at all ...
1
vote
1answer
55 views
11
votes
0answers
207 views
Matlab Neural Network Toolbox vs Wolfram Neural Network Framework
Can anyone who has worked with both Matlab and Mathematica provide some comparison of how the Matlab Neural Network Toolbox compare to that of Mathematica.
Mathematica as far as I understand is a ...
1
vote
0answers
44 views
Loading machine learning library without enabling my discrete Nvidia GPU? [closed]
I've asked a similar question
[here].
I cannot use some of the machine learning modules without enabling my discrete Nvidia GPU.
My setup:
Ubuntu 16.04 on a Dell XPS-15 9560 Intel i7 CPU with 8-...
1
vote
0answers
34 views
NetTrain with GPU crashed
I tried to run NetTrain with TargetDevice->"GPU", and Mathematica crashed. I got the following message:
When I executed ...
2
votes
0answers
46 views
“Learning” to parameterize Hermitian matrices with a basis using neural networks
I'm interested in using neural networks to "learn" how to write down Hermitian matrices, specifically those which are defined over spaces with a specific tensor product structure. The simplest example ...
8
votes
0answers
91 views
Slow down training many neural networks (Bug?)
I am working on something in which I need to train a neural network many times with slightly different training data. I noticed that after many training runs the input rate had dropped significantly.
...
1
vote
0answers
42 views
customized complex loss function to a neural network
My general question is how can I add a customized and complex loss function to neural network?
I have to address this issue ASAP, because I did not find any good examples that can do it. In the loss ...
2
votes
0answers
31 views
How to avoid NetTrain to diverge?
I have a loss NetGraph composed by an Initialised net and a loss net that takes as input an image, a target (represented by a 197-by-7 matrix) and outputs a loss.
I can evaluate this net over a list ...
3
votes
2answers
83 views
3
votes
1answer
41 views
Specify input ports with NetGraph for network within a network
I have a network with two input ports ("a" and "b").
I want to use this net within a bigger network. The problem is that I cannot find a syntax to specify to which input port the previous layers of ...
1
vote
1answer
51 views
Neural network not training due to function not loading
I'm trying to train a neural network on Mathematica 11.3,
but NetTrain won't work and gives the follwoing error:
...
9
votes
1answer
213 views
Creating an indicator function in a neural network
I am working on implementing the loss function of the Yolo version 2 object detection network and building from the construction notebook in the Wolfram Neural Network repository Yolo Version 2 so I ...
0
votes
0answers
32 views
how to train a neural network [duplicate]
I have developed the following code, but I would like to train a neural network so that it can recognize all the dog breeds, integrating many images in order to have a high probability that the ...
2
votes
1answer
53 views
Issue deploying a FormPage using Classify
I developed this code that allows me to recognize what breed is the dog in the inserted image (for the time being developed only for five breeds of dogs), however, when I go to insert the image in ...
5
votes
1answer
105 views
Symbolic Neural Networks in Mathematica
Mathematica is very well known about its symbolic capabilities/functionality. Heavy users usually say that “everything is a symbolic expression”.
Does this principle applies to neural networks?
If ...
2
votes
0answers
27 views
Graphic scaling of neural network SummaryGraphics
Same funky scaling occurs when dragging the SummaryGraphics with the mouse; so, the issue is in the graphics itself not in the ...
1
vote
0answers
53 views
Monitoring the Training Progress through PutAppend
I would like to export the round loss during my model training for each training round. Currently, I am using the way shown in the Documentation Center around TrainingProgressFunction and PutAppend:
<...
9
votes
2answers
98 views
Controlling the randomness of DropoutLayer
How can I control the randomness of DropoutLayer in order to get the same result after each execution?
For example:
...
3
votes
1answer
102 views
Identify emotions from a drawn face using machine learning?
Can someone tell me how you could modify this code so that it recognizes more facial expressions? ... thanks for the help.
...
1
vote
1answer
83 views
What do the numerical values obtained from “FeatureExtraction” mean and what are their applications?
I started a self study on machine learning with mathematica recently. I have seen the power of predict and classify. I am particularly impressed with "FeatureExtraction" function but I really want to ...
0
votes
0answers
42 views
NetTrain doesn't properly train classifier network
I'm using NetTrain to make a simple classifier network that takes integers 0-9 as inputs and classifies them into ten classes labeled by integers 0-9 as well. My training data maps the inputs to the ...
2
votes
0answers
76 views
Neural Network Time Series Input
All,
I am attempting to replicate the work done using Long Short Term Momory Artificial Neural Networks proposed in this thesis by following this (great) example. I have a given dataset for which I ...
0
votes
0answers
27 views
Applying Arbitrary Size Feature Sets to NetTrain
The attached code, worked out at the 2018 Summer Camp, reads a list of training examples, in this cases 93 examples each a list of five features, runs them through NetTrain, then gets back the five ...
3
votes
3answers
95 views
Why Graph does not recognize chains of vertexes like NetGraph
Cross posted on Wolfram Community.
Perfect logic:
NetGraph[{1, 1, 1}, {1 -> 2 -> 3}]
But this does not make sense:
...
4
votes
0answers
53 views
Candidate sampling for softmax neural networks in mathematica
Though I've been using mathematica for a few years, I've never really delved into its ML capabilities (except for the occasional clustering). I'm curious if anyone who has some experience using ...
1
vote
0answers
41 views
problem of result of TopProbabilities in NetModel
I'm on Mathematica 11.3, Classify model could use TopProbabilities without designating an integer.
...
5
votes
1answer
62 views
NetPortGradient output port restriction
The documentation for NetPortGradient says
net[<|..., NetPortGradient[oport] -> ograd|>, NetPortGradient[iport]] can ...
3
votes
0answers
79 views
Backpropagation for manual neural network training
I need to train a neural network manually. Is there a simple way to get the derivatives of all of the learned parameters in the network (with respect to the output) via backpropagation, other than ...
1
vote
0answers
60 views
How to use UnitVectorLayer in a NetChain?
How can I create a NetChain with UnitVectorLayer inside?
In this way I receive this error:
...
1
vote
0answers
92 views
Next element of the list prediction
I want to make a prediction which element will be next in the list.
To make an example, on a certain date certain number appears, so I have a list of {date, number} elements. I wanted to use Predict ...
3
votes
1answer
76 views
-1
votes
1answer
122 views
how to import mathematica trained mxnet neural net
How to import mathematica trained mxnet neural net into python and use it there?
Can someone provide a simple example i can use as a template.
Thanks
4
votes
0answers
66 views
How to do broadcast in NeuralNetworks?
In normal case, we can multiply the tensor by the scalar, vector like this:
...
3
votes
1answer
53 views
Custom “Function” NetDecoder
I was surprised to learn that there is no custom "Function" named decoder for NetDecoder, as there is for NetEncoder. Has anyone ...
2
votes
2answers
128 views
Why doesn't NetTrain use GPU as TargetDevice?
I have a NetTrain call with the following parameters:
tNet = NetTrain[inVecs -> outVecs, TargetDevice -> "GPU"];
But ...
11
votes
3answers
264 views
Convert List of Associations into Association of Lists
For neural networks mathematica likes 2 ways to structure training sets:
...
6
votes
1answer
208 views
How to perform noisy circle detection
I want to detect circles that are embedded in noise. For this I created a few circles with some defined signal-to-noise ratio:
...
3
votes
1answer
91 views
How to use FastText embeddings in a NetGraph?
Does Mathematica 11 have access with either the Wikipedia or CommonCrawl FastText embeddings? Maybe this is built-in through the Neural Net Repository or available through a ...
10
votes
1answer
185 views
Quantile Regression using Neural Networks (Custom Loss function)
I would like to perform a Quantile Regression within Mathematica's neural network framework.
Since there exist a couple of tutorials for this exact problem in Tensorflow, i.e. Deep Quantile ...
3
votes
0answers
60 views
Capsule Network reconstruction layer
I am experimenting the capsule network, using the architecture provided here:
Capsule Network in Mathematica Deep Neural Network Repository
While I can figure out what the network do following the ...
3
votes
0answers
65 views
How to access coefficients and gradients of neural networks?
I would like to test optimization for neural networks for that I need to access the weights/bias of the different layers and the derivatives of the output or a loss function with respect to these ...
3
votes
1answer
32 views
How does NetDecoder for Tokens work?
I'm trying to understand why I can decode encoded word tokens?
...
10
votes
1answer
301 views
NetTrain an image caption generator
I would like to write out the simplest possible word-by-word image caption generator. This network should take an image and build a sentence describing it.
Here is my fashion dataset of images and ...
4
votes
1answer
75 views
How to use NetBidirectionalOperator?
I'm a little uncertain as how to use NetBidirectionalOperator. In other frameworks, switching an LSTM to be bidirectional is an option but you have to double the ...
