Trying to design a small neural network for modeling a LTI system, I'd like to configure a BasicRecurrentLayer with these particular settings:
- No bias vector should be used (I've tried the option "Biases"-> None, but it does not work for a BasicRecurrentLayer)
- The output should be directly the weighted sum of its inputs (I'd like to use Identity instead of Tanh as activation function, which is the default value for this kind of layer)
I could apply a ElementwiseLayer[ArcTanh] at the output of the layer, to somehow undo the effect of Tanh, but still the recurrent connection going backwards to the input port would not be the desired one.
As far as I can see, I can't configure BasicRecurrentLayer to my own needs, so must I then create a new user-defined layer, and make the necessary recurrent connections manually into a NetGraph? How could I do it? I'm a newbie in the neural networks field, and any help is much appreciated.
Thanks in advance, kind regards,