Class: TextNlp::Tokenizer

Inherits:
Object
  • Object
show all
Defined in:
lib/text_nlp/tokenizer.rb

Instance Method Summary collapse

Instance Method Details

#tokenize(text) ⇒ Object 



5
6
7
 
# File 'lib/text_nlp/tokenizer.rb', line 5

def tokenize(text)
  text.split(/\s+/)
end