Class: NLPBackpack::Tokenizer::Custom

Inherits:

Object

Object
NLPBackpack::Tokenizer::Custom

show all

Defined in:: lib/nlp_backpack/tokenizers/custom.rb

Class Method Summary collapse

.tokenize(string, spliter) ⇒ Object

Class Method Details

.tokenize(string, spliter) ⇒ `Object`



6
7
8

# File 'lib/nlp_backpack/tokenizers/custom.rb', line 6

def tokenize(string, spliter)
  string.split(spliter)
end