Class: TwitterCldr::Tokenizers::RbnfTokenizer

Inherits:
Object
  • Object
show all
Defined in:
lib/twitter_cldr/tokenizers/numbers/rbnf_tokenizer.rb

Instance Method Summary collapse

Instance Method Details

#tokenize(pattern) ⇒ Object 



10
11
12
 
# File 'lib/twitter_cldr/tokenizers/numbers/rbnf_tokenizer.rb', line 10

def tokenize(pattern)
  PatternTokenizer.new(nil, tokenizer).tokenize(pattern)
end