Class: DNN::Initializers::He

Inherits:

Initializer

• Object
• Initializer
• DNN::Initializers::He

Defined in:

lib/dnn/core/initializers.rb

Instance Method Summary

• #init_param(layer, param) ⇒ Object

Methods inherited from Initializer

#to_hash

Instance Method Details

#init_param(layer, param) ⇒ Object

# File 'lib/dnn/core/initializers.rb', line 80

def init_param(layer, param)
  num_prev_nodes = layer.prev_layer.shape.reduce(:*)
  param.data = param.data.rand_norm / Math.sqrt(num_prev_nodes) * Math.sqrt(2)
end