Class: Tokenizers::Models::Unigram

Inherits:

Object

Object
Tokenizers::Models::Unigram

Defined in:: lib/tokenizers/models/unigram.rb

Class Method Summary collapse

.new(vocab: nil, unk_id: nil, byte_fallback: nil) ⇒ Object

Class Method Details

.new(vocab: nil, unk_id: nil, byte_fallback: nil) ⇒ `Object`



4
5
6

# File 'lib/tokenizers/models/unigram.rb', line 4

def self.new(vocab: nil, unk_id: nil, byte_fallback: nil)
  _new(vocab, unk_id, byte_fallback)
end