Class: RubyZero::NN::Optimizers::Optimizer

Inherits:
Object
  • Object
show all
Defined in:
lib/rubyzero/nn/optimizers/optimizer.rb

Overview

base of optimizer classes

Direct Known Subclasses

Momentum, SGD

Instance Method Summary collapse

Constructor Details

#initialize(parameters, lr: 0.01) ⇒ Optimizer

Returns a new instance of Optimizer.



4
5
6
 
# File 'lib/rubyzero/nn/optimizers/optimizer.rb', line 4

def initialize(parameters, lr:0.01)

end

Instance Method Details

#update ⇒ Object 



7
8
9
 
# File 'lib/rubyzero/nn/optimizers/optimizer.rb', line 7

def update()

end

#zero_grad ⇒ Object 



10
11
12
13
14
 
# File 'lib/rubyzero/nn/optimizers/optimizer.rb', line 10

def zero_grad()
    @parameters.each do |parameter|
        parameter.grad = parameter.zeros_like()
    end
end