Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

1
vote
0answers
32 views

How to use BERT for embeddings?

Does anyone know of a way to get the BERT model working for word embeddings in Mathematica? Doesn’t seem to be available on GitHub or the Wolfram Net Repo...
1
vote
1answer
24 views

Error NetTrain::invencin: Invalid input when training a neural network [on hold]

I've build a Deep neural network with various variables: ...
8
votes
1answer
106 views

How do I implement masked Softmax?

Consider: input = {1, 2, 3}; mask = {1, 0, 1} Classic Softmax: SoftmaxLayer[]@input {0.0900306, 0.244728, 0.665241} ...
2
votes
1answer
39 views

How to Provide an RNN various type of inputs?

I'm trying to build an RNN in Mathematica. My window is only 2 but the variables are of different types: ...
4
votes
0answers
32 views

How to implement external memory for the “memory augmented neural network”?

I am trying to implement the memory-augmented neural network using MMA 11.3. The memory-augmented neural network in based on the paper here. There are implementations using ...
0
votes
0answers
61 views

Robust face detection

FindFaces doesn't work when people are far away from the camera. I'm looking for a single accurate method of detecting one or more people in an images, at all ...
1
vote
1answer
55 views

Training a Neural Network on a rule of List

Is is possible to train this format of data? ...
11
votes
0answers
207 views

Matlab Neural Network Toolbox vs Wolfram Neural Network Framework

Can anyone who has worked with both Matlab and Mathematica provide some comparison of how the Matlab Neural Network Toolbox compare to that of Mathematica. Mathematica as far as I understand is a ...
1
vote
0answers
44 views

Loading machine learning library without enabling my discrete Nvidia GPU? [closed]

I've asked a similar question [here]. I cannot use some of the machine learning modules without enabling my discrete Nvidia GPU. My setup: Ubuntu 16.04 on a Dell XPS-15 9560 Intel i7 CPU with 8-...
1
vote
0answers
34 views

NetTrain with GPU crashed

I tried to run NetTrain with TargetDevice->"GPU", and Mathematica crashed. I got the following message: When I executed ...
2
votes
0answers
46 views

“Learning” to parameterize Hermitian matrices with a basis using neural networks

I'm interested in using neural networks to "learn" how to write down Hermitian matrices, specifically those which are defined over spaces with a specific tensor product structure. The simplest example ...
8
votes
0answers
91 views

Slow down training many neural networks (Bug?)

I am working on something in which I need to train a neural network many times with slightly different training data. I noticed that after many training runs the input rate had dropped significantly. ...
1
vote
0answers
42 views

customized complex loss function to a neural network

My general question is how can I add a customized and complex loss function to neural network? I have to address this issue ASAP, because I did not find any good examples that can do it. In the loss ...
2
votes
0answers
31 views

How to avoid NetTrain to diverge?

I have a loss NetGraph composed by an Initialised net and a loss net that takes as input an image, a target (represented by a 197-by-7 matrix) and outputs a loss. I can evaluate this net over a list ...
3
votes
2answers
83 views

Answer multiple choice questions

FindTextualAnswer isn't working for me here: ...
3
votes
1answer
41 views

Specify input ports with NetGraph for network within a network

I have a network with two input ports ("a" and "b"). I want to use this net within a bigger network. The problem is that I cannot find a syntax to specify to which input port the previous layers of ...
1
vote
1answer
51 views

Neural network not training due to function not loading

I'm trying to train a neural network on Mathematica 11.3, but NetTrain won't work and gives the follwoing error: ...
9
votes
1answer
213 views

Creating an indicator function in a neural network

I am working on implementing the loss function of the Yolo version 2 object detection network and building from the construction notebook in the Wolfram Neural Network repository Yolo Version 2 so I ...
0
votes
0answers
32 views

how to train a neural network [duplicate]

I have developed the following code, but I would like to train a neural network so that it can recognize all the dog breeds, integrating many images in order to have a high probability that the ...
2
votes
1answer
53 views

Issue deploying a FormPage using Classify

I developed this code that allows me to recognize what breed is the dog in the inserted image (for the time being developed only for five breeds of dogs), however, when I go to insert the image in ...
5
votes
1answer
105 views

Symbolic Neural Networks in Mathematica

Mathematica is very well known about its symbolic capabilities/functionality. Heavy users usually say that “everything is a symbolic expression”. Does this principle applies to neural networks? If ...
2
votes
0answers
27 views

Graphic scaling of neural network SummaryGraphics

Same funky scaling occurs when dragging the SummaryGraphics with the mouse; so, the issue is in the graphics itself not in the ...
1
vote
0answers
53 views

Monitoring the Training Progress through PutAppend

I would like to export the round loss during my model training for each training round. Currently, I am using the way shown in the Documentation Center around TrainingProgressFunction and PutAppend: <...
9
votes
2answers
98 views

Controlling the randomness of DropoutLayer

How can I control the randomness of DropoutLayer in order to get the same result after each execution? For example: ...
3
votes
1answer
102 views

Identify emotions from a drawn face using machine learning?

Can someone tell me how you could modify this code so that it recognizes more facial expressions? ... thanks for the help. ...
1
vote
1answer
83 views

What do the numerical values obtained from “FeatureExtraction” mean and what are their applications?

I started a self study on machine learning with mathematica recently. I have seen the power of predict and classify. I am particularly impressed with "FeatureExtraction" function but I really want to ...
0
votes
0answers
42 views

NetTrain doesn't properly train classifier network

I'm using NetTrain to make a simple classifier network that takes integers 0-9 as inputs and classifies them into ten classes labeled by integers 0-9 as well. My training data maps the inputs to the ...
2
votes
0answers
76 views

Neural Network Time Series Input

All, I am attempting to replicate the work done using Long Short Term Momory Artificial Neural Networks proposed in this thesis by following this (great) example. I have a given dataset for which I ...
0
votes
0answers
27 views

Applying Arbitrary Size Feature Sets to NetTrain

The attached code, worked out at the 2018 Summer Camp, reads a list of training examples, in this cases 93 examples each a list of five features, runs them through NetTrain, then gets back the five ...
3
votes
3answers
95 views

Why Graph does not recognize chains of vertexes like NetGraph

Cross posted on Wolfram Community. Perfect logic: NetGraph[{1, 1, 1}, {1 -> 2 -> 3}] But this does not make sense: ...
4
votes
0answers
53 views

Candidate sampling for softmax neural networks in mathematica

Though I've been using mathematica for a few years, I've never really delved into its ML capabilities (except for the occasional clustering). I'm curious if anyone who has some experience using ...
1
vote
0answers
41 views

problem of result of TopProbabilities in NetModel

I'm on Mathematica 11.3, Classify model could use TopProbabilities without designating an integer. ...
5
votes
1answer
62 views

NetPortGradient output port restriction

The documentation for NetPortGradient says net[<|..., NetPortGradient[oport] -> ograd|>, NetPortGradient[iport]] can ...
3
votes
0answers
79 views

Backpropagation for manual neural network training

I need to train a neural network manually. Is there a simple way to get the derivatives of all of the learned parameters in the network (with respect to the output) via backpropagation, other than ...
1
vote
0answers
60 views

How to use UnitVectorLayer in a NetChain?

How can I create a NetChain with UnitVectorLayer inside? In this way I receive this error: ...
1
vote
0answers
92 views

Next element of the list prediction

I want to make a prediction which element will be next in the list. To make an example, on a certain date certain number appears, so I have a list of {date, number} elements. I wanted to use Predict ...
3
votes
1answer
76 views

Why does this NetTrain example fail?

I have some training data of the form {{x, y}, bool}, e.g. ...
-1
votes
1answer
122 views

how to import mathematica trained mxnet neural net

How to import mathematica trained mxnet neural net into python and use it there? Can someone provide a simple example i can use as a template. Thanks
4
votes
0answers
66 views

How to do broadcast in NeuralNetworks?

In normal case, we can multiply the tensor by the scalar, vector like this: ...
3
votes
1answer
53 views

Custom “Function” NetDecoder

I was surprised to learn that there is no custom "Function" named decoder for NetDecoder, as there is for NetEncoder. Has anyone ...
2
votes
2answers
128 views

Why doesn't NetTrain use GPU as TargetDevice?

I have a NetTrain call with the following parameters: tNet = NetTrain[inVecs -> outVecs, TargetDevice -> "GPU"]; But ...
11
votes
3answers
264 views

Convert List of Associations into Association of Lists

For neural networks mathematica likes 2 ways to structure training sets: ...
6
votes
1answer
208 views

How to perform noisy circle detection

I want to detect circles that are embedded in noise. For this I created a few circles with some defined signal-to-noise ratio: ...
3
votes
1answer
91 views

How to use FastText embeddings in a NetGraph?

Does Mathematica 11 have access with either the Wikipedia or CommonCrawl FastText embeddings? Maybe this is built-in through the Neural Net Repository or available through a ...
10
votes
1answer
185 views

Quantile Regression using Neural Networks (Custom Loss function)

I would like to perform a Quantile Regression within Mathematica's neural network framework. Since there exist a couple of tutorials for this exact problem in Tensorflow, i.e. Deep Quantile ...
3
votes
0answers
60 views

Capsule Network reconstruction layer

I am experimenting the capsule network, using the architecture provided here: Capsule Network in Mathematica Deep Neural Network Repository While I can figure out what the network do following the ...
3
votes
0answers
65 views

How to access coefficients and gradients of neural networks?

I would like to test optimization for neural networks for that I need to access the weights/bias of the different layers and the derivatives of the output or a loss function with respect to these ...
3
votes
1answer
32 views

How does NetDecoder for Tokens work?

I'm trying to understand why I can decode encoded word tokens? ...
10
votes
1answer
301 views

NetTrain an image caption generator

I would like to write out the simplest possible word-by-word image caption generator. This network should take an image and build a sentence describing it. Here is my fashion dataset of images and ...
4
votes
1answer
75 views

How to use NetBidirectionalOperator?

I'm a little uncertain as how to use NetBidirectionalOperator. In other frameworks, switching an LSTM to be bidirectional is an option but you have to double the ...