Class: CooCoo::ActivationFunctions::SoftMax

Inherits:

Identity

• Object
• Identity
• CooCoo::ActivationFunctions::SoftMax

Defined in:

lib/coo-coo/activation_functions.rb

Overview

Computes the Softmax function given a Vector:

y_i = e ** x_i / sum(e ** x)

See Also:

• https://deepnotes.io/softmax-crossentropy
• https://becominghuman.ai/back-propagation-is-very-simple-who-made-it-complicated-97b794c97e5c

Direct Known Subclasses

ShiftedSoftMax

Instance Method Summary

• #call(x) ⇒ Object
• #derivative(x, y = nil) ⇒ Object

Methods inherited from Identity

#initial_bias, #initial_weights, method_missing, #name, #prep_input, #prep_output_target, #to_s

Instance Method Details

#call(x) ⇒ Object

# File 'lib/coo-coo/activation_functions.rb', line 215

def call(x)
  e = x.exp
  e / e.sum
end

#derivative(x, y = nil) ⇒ Object

# File 'lib/coo-coo/activation_functions.rb', line 220

def derivative(x, y = nil)
  y ||= call(x)
  s = x.exp.sum
  y * (s - x) / s
end