Method: Transformers::Mpnet::MPNetPooler#initialize

Defined in:
lib/transformers/models/mpnet/modeling_mpnet.rb

#initialize(config) ⇒ MPNetPooler

Returns a new instance of MPNetPooler.



367
368
369
370
371
 
# File 'lib/transformers/models/mpnet/modeling_mpnet.rb', line 367

def initialize(config)
  super()
  @dense = Torch::NN::Linear.new(config.hidden_size, config.hidden_size)
  @activation = Torch::NN::Tanh.new
end