Class: Tokenizers::PreTokenizers::Digits

Inherits:
Object
  • Object
show all
Defined in:
lib/tokenizers/pre_tokenizers/digits.rb

Class Method Summary collapse

Class Method Details

.new(individual_digits: false) ⇒ Object 



4
5
6
 
# File 'lib/tokenizers/pre_tokenizers/digits.rb', line 4

def self.new(individual_digits: false)
  _new(individual_digits)
end