Class: DNN::Ridge
- Inherits:
-
Object
- Object
- DNN::Ridge
- Defined in:
- lib/dnn/core/regularizers.rb
Instance Method Summary collapse
- #backward ⇒ Object
- #forward(x) ⇒ Object
-
#initialize(l2_lambda, param) ⇒ Ridge
constructor
A new instance of Ridge.
Constructor Details
#initialize(l2_lambda, param) ⇒ Ridge
Returns a new instance of Ridge.
22 23 24 25 |
# File 'lib/dnn/core/regularizers.rb', line 22 def initialize(l2_lambda, param) @l2_lambda = l2_lambda @param = param end |
Instance Method Details
#backward ⇒ Object
31 32 33 |
# File 'lib/dnn/core/regularizers.rb', line 31 def backward @param.grad += @l2_lambda * @param.data end |
#forward(x) ⇒ Object
27 28 29 |
# File 'lib/dnn/core/regularizers.rb', line 27 def forward(x) x + 0.5 * @l2_lambda * (@param.data**2).sum end |