Class: NLPBackpack::Tokenizer::Word

Inherits:

Object

Object
NLPBackpack::Tokenizer::Word

show all

Defined in:: lib/nlp_backpack/tokenizers/word.rb

Class Method Summary collapse

.tokenize(string) ⇒ Object

Class Method Details

.tokenize(string) ⇒ `Object`



6
7
8

# File 'lib/nlp_backpack/tokenizers/word.rb', line 6

def tokenize(string)
  string.split(/\W*\s/)
end