Class: DNN::Ridge

Inherits:
Object
  • Object
show all
Defined in:
lib/dnn/core/regularizers.rb

Instance Method Summary collapse

Constructor Details

#initialize(l2_lambda, param) ⇒ Ridge

Returns a new instance of Ridge.



22
23
24
25
# File 'lib/dnn/core/regularizers.rb', line 22

def initialize(l2_lambda, param)
  @l2_lambda = l2_lambda
  @param = param
end

Instance Method Details

#backward ⇒ Object



31
32
33
# File 'lib/dnn/core/regularizers.rb', line 31

def backward
  @param.grad += @l2_lambda * @param.data
end

#forward(x) ⇒ Object



27
28
29
# File 'lib/dnn/core/regularizers.rb', line 27

def forward(x)
  x + 0.5 * @l2_lambda * (@param.data**2).sum
end