Timeline for Gathering activations that occur inside a neural net during training
Current License: CC BY-SA 3.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 5, 2017 at 14:55 | answer | added | Taliesin Beynon | timeline score: 5 | |
| Apr 5, 2017 at 8:20 | comment | added | Sascha | @xslittlegrass I want explicitly the activations that occur when applying the partially trained net to the current batch (which might be just of size 1 in the case of online learning). | |
| Apr 4, 2017 at 20:22 | history | tweeted | twitter.com/StackMma/status/849356618244526080 | ||
| Apr 4, 2017 at 20:17 | comment | added | xslittlegrass |
It seems to me that what EvaluationMonitor/StepMonitor gives in NDSolve is the current solution as we trying to improve it, and it is similar to the partially trained net that TrainingProgressFunction allows us to access. Since we have the access to the partially trained net, it seems easy to evaluate it on some test data and get the activations. But perhaps you want explicitly the partially trained net to evaluate on the current training batch?
|
|
| Apr 4, 2017 at 18:27 | comment | added | Sascha |
@xslittlegrass The filters/weights are not what I am after - I need the activations produced during a forward pass through the net. What I am actually doing is a simple form of actor/critic reinforcement learning and I would like to visualize the averaged received reward (per class) during training. Essentially I am asking for what is EvaluationMonitor/StepMonitor to NDSolve only for neural nets .
|
|
| Apr 4, 2017 at 15:24 | comment | added | xslittlegrass |
I'm not sure whether this is what you ask, but since you have access to the partially trained net in TrainingProgressFunction, you may extract the weights using NetExtract inside TrainingProgressFunction as you train the net. And at the end, you can visualize the histogram of the weights at different training time.
|
|
| Apr 4, 2017 at 13:39 | history | asked | Sascha | CC BY-SA 3.0 |