Class: Tokenizers::PreTokenizers::Metaspace

Inherits:

Object

Object
Tokenizers::PreTokenizers::Metaspace

Defined in:: lib/tokenizers/pre_tokenizers/metaspace.rb

Class Method Summary collapse

.new(replacement: "\u2581", add_prefix_space: true) ⇒ Object

Class Method Details

.new(replacement: "\u2581", add_prefix_space: true) ⇒ `Object`



4
5
6

# File 'lib/tokenizers/pre_tokenizers/metaspace.rb', line 4

def self.new(replacement: "\u2581", add_prefix_space: true)
  _new(replacement, add_prefix_space)
end