Class: TwitterCldr::Tokenizers::RbnfTokenizer

Inherits:

Object

Object
TwitterCldr::Tokenizers::RbnfTokenizer

show all

Defined in:: lib/twitter_cldr/tokenizers/numbers/rbnf_tokenizer.rb

Instance Method Summary collapse

#tokenize(pattern) ⇒ Object

Instance Method Details

#tokenize(pattern) ⇒ `Object`



10
11
12

# File 'lib/twitter_cldr/tokenizers/numbers/rbnf_tokenizer.rb', line 10

def tokenize(pattern)
  PatternTokenizer.new(nil, tokenizer).tokenize(pattern)
end