Class: DNN::Lasso

Inherits:

Object

• Object
• DNN::Lasso

Defined in:

lib/dnn/core/regularizers.rb

Instance Method Summary

• #backward ⇒ Object
• #forward(x) ⇒ Object
• #initialize(l1_lambda, param) ⇒ Lasso constructor

  A new instance of Lasso.

Constructor Details

#initialize(l1_lambda, param) ⇒ Lasso

Returns a new instance of Lasso.

# File 'lib/dnn/core/regularizers.rb', line 4

def initialize(l1_lambda, param)
  @l1_lambda = l1_lambda
  @param = param
end

Instance Method Details

#backward ⇒ Object

# File 'lib/dnn/core/regularizers.rb', line 13

def backward
  dlasso = Xumo::SFloat.ones(*@param.data.shape)
  dlasso[@param.data < 0] = -1
  @param.grad += @l1_lambda * dlasso
end

#forward(x) ⇒ Object

# File 'lib/dnn/core/regularizers.rb', line 9

def forward(x)
  x + @l1_lambda * @param.data.abs.sum
end