Module: CooCoo::ActivationFunctions
- Extended by:
- FromName
- Defined in:
- lib/coo-coo/activation_functions.rb
Overview
Activation functions are functions of a single variable used by some Layers to introduce non-linearities into or to alter data from a previous layer.
To get an activation function instance use the included FromName#from_name. From there you can call the methods found on the Identity activation function on any activation function.
To create a new activation function that can be used in stored networks, you must subclass Identity and call FromName#register.
Defined Under Namespace
Classes: Identity, LeakyReLU, Logistic, MinMax, Normalize, ReLU, ShiftedSoftMax, SoftMax, TanH, ZeroSafeMinMax, ZeroSafeNormalize