Class: RubyTokenizer::Tokenizer

Inherits:
Object
  • Object
show all
Includes:
Patterns
Defined in:
lib/ruby_tokenizer.rb

Constant Summary

Constants included from Patterns

Patterns::BASIC, Patterns::MISC, Patterns::PARENS, Patterns::PUNCTUATION

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Patterns

basic

Constructor Details

#initialize(text) ⇒ Tokenizer

Returns a new instance of Tokenizer.



10
11
12
# File 'lib/ruby_tokenizer.rb', line 10

def initialize(text)
  @text = text
end

Instance Attribute Details

#textObject (readonly)

Returns the value of attribute text.



8
9
10
# File 'lib/ruby_tokenizer.rb', line 8

def text
  @text
end

Instance Method Details

#rankObject



14
15
16
17
# File 'lib/ruby_tokenizer.rb', line 14

def rank
  ranked = Hash[self.frequency.sort_by { |_word, count| count }.reverse]
  ranked.first(10)
end