We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [neural-networks]

Questions involving defining, training, executing, importing and exporting neural networks.

Filter by
Sorted by
Tagged with
9
votes
1answer
330 views

How do I implement masked Softmax?

Consider: input = {1, 2, 3}; mask = {1, 0, 1} Classic Softmax: SoftmaxLayer[]@input {0.0900306, 0.244728, 0.665241} ...
4
votes
0answers
55 views

How to implement external memory for the “memory augmented neural network”?

I am trying to implement the memory-augmented neural network using MMA 11.3. The memory-augmented neural network in based on the paper here. There are implementations using ...
1
vote
1answer
90 views

Training a Neural Network on a rule of List

Is is possible to train this format of data? ...
3
votes
1answer
65 views

Specify input ports with NetGraph for network within a network

I have a network with two input ports ("a" and "b"). I want to use this net within a bigger network. The problem is that I cannot find a syntax to specify to which input port the previous layers of ...
1
vote
0answers
55 views

Loading machine learning library without enabling my discrete Nvidia GPU? [closed]

I've asked a similar question [here]. I cannot use some of the machine learning modules without enabling my discrete Nvidia GPU. My setup: Ubuntu 16.04 on a Dell XPS-15 9560 Intel i7 CPU with 8-...
12
votes
0answers
476 views

Matlab Neural Network Toolbox vs Wolfram Neural Network Framework [closed]

Can anyone who has worked with both Matlab and Mathematica provide some comparison of how the Matlab Neural Network Toolbox compare to that of Mathematica. Mathematica as far as I understand is a ...
8
votes
0answers
112 views

Slow down training many neural networks (Bug?)

I am working on something in which I need to train a neural network many times with slightly different training data. I noticed that after many training runs the input rate had dropped significantly. ...
1
vote
0answers
53 views

NetTrain with GPU crashed

I tried to run NetTrain with TargetDevice->"GPU", and Mathematica crashed. I got the following message: When I executed ...
2
votes
0answers
58 views

“Learning” to parameterize Hermitian matrices with a basis using neural networks

I'm interested in using neural networks to "learn" how to write down Hermitian matrices, specifically those which are defined over spaces with a specific tensor product structure. The simplest example ...
1
vote
1answer
84 views

Neural network not training due to function not loading

I'm trying to train a neural network on Mathematica 11.3, but NetTrain won't work and gives the follwoing error: ...
1
vote
0answers
125 views

customized complex loss function to a neural network

My general question is how can I add a customized and complex loss function to neural network? I have to address this issue ASAP, because I did not find any good examples that can do it. In the loss ...
11
votes
2answers
685 views

Inspecting intermediate values in a neural network

Basically one creates a NetChain of several layers, trains it and by evaluating model[testdata], the prediction can be obtained. ...
4
votes
1answer
135 views

How can I reproduce the result of AgeEstimation model in MXNet-Python?

How can I reproduce the result of AgeEstimation model in MXNet-Python? here is my repo about MXnet-Python codes to load Mathematica Models. I want the result of Mathematica and the result of MXNet-...
11
votes
1answer
438 views

Creating an indicator function in a neural network

I am working on implementing the loss function of the Yolo version 2 object detection network and building from the construction notebook in the Wolfram Neural Network repository Yolo Version 2 so I ...
9
votes
2answers
123 views

Controlling the randomness of DropoutLayer

How can I control the randomness of DropoutLayer in order to get the same result after each execution? For example: ...
0
votes
0answers
39 views

how to train a neural network [duplicate]

I have developed the following code, but I would like to train a neural network so that it can recognize all the dog breeds, integrating many images in order to have a high probability that the ...
2
votes
1answer
75 views

Issue deploying a FormPage using Classify

I developed this code that allows me to recognize what breed is the dog in the inserted image (for the time being developed only for five breeds of dogs), however, when I go to insert the image in ...
4
votes
1answer
129 views

Value for output of layer is inconsistent (implementing SqueezeUNET from Keras)

I'm attempting to implement this neural network in WL: https://github.com/lhelontra/squeeze-unet/blob/master/squeezeunet.py which is a variant of the SqueezeNet network that does image segmentation. ...
2
votes
0answers
31 views

Graphic scaling of neural network SummaryGraphics

Same funky scaling occurs when dragging the SummaryGraphics with the mouse; so, the issue is in the graphics itself not in the ...
1
vote
0answers
62 views

Monitoring the Training Progress through PutAppend

I would like to export the round loss during my model training for each training round. Currently, I am using the way shown in the Documentation Center around TrainingProgressFunction and PutAppend: <...
3
votes
1answer
124 views

Identify emotions from a drawn face using machine learning?

Can someone tell me how you could modify this code so that it recognizes more facial expressions? ... thanks for the help. ...
1
vote
1answer
101 views

What do the numerical values obtained from “FeatureExtraction” mean and what are their applications?

I started a self study on machine learning with mathematica recently. I have seen the power of predict and classify. I am particularly impressed with "FeatureExtraction" function but I really want to ...
0
votes
0answers
49 views

NetTrain doesn't properly train classifier network

I'm using NetTrain to make a simple classifier network that takes integers 0-9 as inputs and classifies them into ten classes labeled by integers 0-9 as well. My training data maps the inputs to the ...
2
votes
0answers
161 views

Neural Network Time Series Input

All, I am attempting to replicate the work done using Long Short Term Momory Artificial Neural Networks proposed in this thesis by following this (great) example. I have a given dataset for which I ...
0
votes
0answers
29 views

Applying Arbitrary Size Feature Sets to NetTrain

The attached code, worked out at the 2018 Summer Camp, reads a list of training examples, in this cases 93 examples each a list of five features, runs them through NetTrain, then gets back the five ...
10
votes
1answer
3k views

How can image segmentation from UNET be improved?

EDIT 2: code can be found @ https://github.com/alihashmiii/UNet-Segmentation-Wolfram EDIT 1: applying Binarize to the masks after resizing helps to ensure the data for mask is binary I have made an ...
15
votes
1answer
418 views

Training Neural Networks on Cloud GPUs (Wolfram Cloud / AWS / Paperspace /etc)

I have spent a lot of time lately training neural networks. However, my poor laptop has only an AMD GPU, so I am stuck training these networks on the CPU. That means I get to train networks over ...
3
votes
3answers
108 views

Why Graph does not recognize chains of vertexes like NetGraph

Cross posted on Wolfram Community. Perfect logic: NetGraph[{1, 1, 1}, {1 -> 2 -> 3}] But this does not make sense: ...
4
votes
0answers
60 views

Candidate sampling for softmax neural networks in mathematica

Though I've been using mathematica for a few years, I've never really delved into its ML capabilities (except for the occasional clustering). I'm curious if anyone who has some experience using ...
1
vote
0answers
87 views

How to use UnitVectorLayer in a NetChain?

How can I create a NetChain with UnitVectorLayer inside? In this way I receive this error: ...
1
vote
0answers
112 views

Next element of the list prediction

I want to make a prediction which element will be next in the list. To make an example, on a certain date certain number appears, so I have a list of {date, number} elements. I wanted to use Predict ...
3
votes
1answer
102 views

Why does this NetTrain example fail?

I have some training data of the form {{x, y}, bool}, e.g. ...
-1
votes
1answer
185 views

how to import mathematica trained mxnet neural net

How to import mathematica trained mxnet neural net into python and use it there? Can someone provide a simple example i can use as a template. Thanks
4
votes
0answers
100 views

How to do broadcast in NeuralNetworks?

In normal case, we can multiply the tensor by the scalar, vector like this: ...
3
votes
1answer
85 views

Custom “Function” NetDecoder

I was surprised to learn that there is no custom "Function" named decoder for NetDecoder, as there is for NetEncoder. Has anyone ...
12
votes
2answers
461 views

How to define a PixelShuffle Layer?

PixelShuffleLayer come from Real-Time_Single_Image. Firstly, a $C\times H\times W$ image, after a convolution, now $f^2\cdot C \times H\times W$, then sub-pix, finally get a $ C \times fH\times fW$ ...
10
votes
1answer
375 views

NetTrain an image caption generator

I would like to write out the simplest possible word-by-word image caption generator. This network should take an image and build a sentence describing it. Here is my fashion dataset of images and ...
12
votes
3answers
344 views

Convert List of Associations into Association of Lists

For neural networks mathematica likes 2 ways to structure training sets: ...
4
votes
1answer
94 views

How to use NetBidirectionalOperator?

I'm a little uncertain as how to use NetBidirectionalOperator. In other frameworks, switching an LSTM to be bidirectional is an option but you have to double the ...
7
votes
1answer
669 views

How to perform noisy circle detection

I want to detect circles that are embedded in noise. For this I created a few circles with some defined signal-to-noise ratio: ...
11
votes
1answer
310 views

Quantile Regression using Neural Networks (Custom Loss function)

I would like to perform a Quantile Regression within Mathematica's neural network framework. Since there exist a couple of tutorials for this exact problem in Tensorflow, i.e. Deep Quantile ...
3
votes
1answer
145 views

How to use FastText embeddings in a NetGraph?

Does Mathematica 11 have access with either the Wikipedia or CommonCrawl FastText embeddings? Maybe this is built-in through the Neural Net Repository or available through a ...
13
votes
2answers
558 views

How to implement a triplet network with NetSharedArray?

In v11.3, NetSharedArray[] and NetInsertSharedArray[] give us a mechanism of sharing weights and biases across neural networks, ...
4
votes
0answers
94 views

Capsule Network reconstruction layer

I am experimenting the capsule network, using the architecture provided here: Capsule Network in Mathematica Deep Neural Network Repository While I can figure out what the network do following the ...
1
vote
1answer
349 views

Mathematica Machine Learning (Method “NeuralNetwork”)

I am trying to use Predict and Classify functions. I am interested what NetworkDepth really ...
5
votes
0answers
168 views

GPU Acceleration and the Predict function [duplicate]

With the Mathematica Predict function, does it automatically use GPU acceleration? For example, with NetTrain, one has to specify TargetDevice->"GPU" to show they want to perform the calculation on ...
3
votes
0answers
82 views

How to access coefficients and gradients of neural networks?

I would like to test optimization for neural networks for that I need to access the weights/bias of the different layers and the derivatives of the output or a loss function with respect to these ...
3
votes
1answer
42 views

How does NetDecoder for Tokens work?

I'm trying to understand why I can decode encoded word tokens? ...
5
votes
1answer
76 views

Neural network with adaptive color channel

If we have a grayscale network ("Input" -> {1, Automatic, Automatic}), it can be applied on both gray and color image by: ...
6
votes
2answers
116 views

How does “BeamSearch” work?

I'd like to see a more intuitive example of what this type of net decoder actually does (in the context of lstm's and text/caption generation). This is the only example in the docs: and I have no ...