Class: Tokenizers::Processors::RobertaProcessing

Inherits:
Object
  • Object
show all
Defined in:
lib/tokenizers/processors/roberta_processing.rb

Class Method Summary collapse

Class Method Details

.new(sep, cls, trim_offsets: true, add_prefix_space: true) ⇒ Object 



4
5
6
 
# File 'lib/tokenizers/processors/roberta_processing.rb', line 4

def self.new(sep, cls, trim_offsets: true, add_prefix_space: true)
  _new(sep, cls, trim_offsets, add_prefix_space)
end