Class: TextNlp::Tokenizer

Inherits:

Object

Object
TextNlp::Tokenizer

show all

Defined in:: lib/text_nlp/tokenizer.rb

Instance Method Summary collapse

#tokenize(text) ⇒ Object

Instance Method Details

#tokenize(text) ⇒ `Object`



5
6
7

# File 'lib/text_nlp/tokenizer.rb', line 5

def tokenize(text)
  text.split(/\s+/)
end