Class: DNN::Initializers::He

Inherits:

Initializer

• Object
• Initializer
• DNN::Initializers::He

Defined in:

lib/dnn/core/initializers.rb

Instance Method Summary

• #init_param(layer, param) ⇒ Object
• #initialize(seed = true) ⇒ He constructor

  A new instance of He.

Methods inherited from Initializer

#to_hash

Constructor Details

#initialize(seed = true) ⇒ He

Returns a new instance of He.

# File 'lib/dnn/core/initializers.rb', line 114

def initialize(seed = true)
  super
end

Instance Method Details

#init_param(layer, param) ⇒ Object

# File 'lib/dnn/core/initializers.rb', line 118

def init_param(layer, param)
  Xumo::SFloat.srand(@seed)
  num_prev_nodes = layer.input_shape.reduce(:*)
  param.data = param.data.rand_norm / Math.sqrt(num_prev_nodes) * Math.sqrt(2)
end