Class: NLPBackpack::Tokenizer::Space

Inherits:

Object

Object
NLPBackpack::Tokenizer::Space

show all

Defined in:: lib/nlp_backpack/tokenizers/space.rb

Class Method Summary collapse

.tokenize(string) ⇒ Object

Class Method Details

.tokenize(string) ⇒ `Object`



6
7
8

# File 'lib/nlp_backpack/tokenizers/space.rb', line 6

def tokenize(string)
  string.split(/\s{1}/)
end