All Questions
Tagged with machine-learning calculus-and-analysis
8 questions
0
votes
1
answer
84
views
Gradient of tensor expressions
I would like to compute gradients of tensor expressions without having to instantiate particular tensors and for arbitrary sizes.
Example 1 :
For example, let's say I want to minimize $C=\sum_j(\sum_i ...
- 101
1
vote
0
answers
33
views
Differentiating matrix function in `Table` from
I am trying to get an analytical expression for derivaives of an algorithm explained here.
I usually use automatic diff. a lot, but since this part of function will not change, I thought to implement ...
- 111
5
votes
0
answers
142
views
Derivation from a network
how can I represent the derivative of a network (e.g. NetGraph or NetChain) as a network? I have tried it with FunctionLayer[] and NetPortGradient, but without success.
I would be very pleased to ...
- 91
1
vote
1
answer
99
views
Derivative of predictor function
Given some data dat, we would like to generate a predictor function. Therefore we use
...
- 1,587
11
votes
1
answer
723
views
Deep learning outperforms in symbolic integration and ODE?
There comes a new paper on arXiv (arXiv 1912.01412, Deep Learning for Symbolic Mathematics by
Guillaume Lample, François Charton) claiming that a deep learning model outperforms Mathematica a lot in ...
- 4,758
2
votes
0
answers
270
views
Hessian of a loss function for a neural netwrok
Is a way to calculate the Hessian of the loss function in Mathematica. It's easy to define a loss function for neural nets but I couldn't figure out how to calculate the Hessian(more precisely I ...
- 727
3
votes
2
answers
468
views
Derivative of rectified linear unit in Mathematica?
I am following the artificial neural networks literature and apparently the latest trend is to use the rectified linear units (ReLU) as the activation functions for each neuron. I tried to take the ...
- 31
3
votes
2
answers
2k
views
How to get the training error and the validation error using Classify function with SVM
I am using Classify[] function with Support vector machine model. I need to analyze the quality of results by analyzing the training error and the validation error ...
- 2,046