Class: NLPBackpack::Tokenizer::Whitespace

Inherits:

Object

Object
NLPBackpack::Tokenizer::Whitespace

show all

Defined in:: lib/nlp_backpack/tokenizers/whitespace.rb

Class Method Summary collapse

.tokenize(string) ⇒ Object

Class Method Details

.tokenize(string) ⇒ `Object`



6
7
8

# File 'lib/nlp_backpack/tokenizers/whitespace.rb', line 6

def tokenize(string)
  string.split
end