Method: NLPBackpack::Tokenizer::Word.tokenize

Defined in:
lib/nlp_backpack/tokenizers/word.rb

.tokenize(string) ⇒ Object 



6
7
8
 
# File 'lib/nlp_backpack/tokenizers/word.rb', line 6

def tokenize(string)
  string.split(/\W*\s/)
end