Class: MiniSearch::NgramTokenizer

Inherits:

Object

• Object
• MiniSearch::NgramTokenizer

Defined in:

lib/mini_search/ngram_tokenizer.rb

Instance Method Summary

• #execute(string) ⇒ Object
• #initialize(n) ⇒ NgramTokenizer constructor

  A new instance of NgramTokenizer.

Constructor Details

#initialize(n) ⇒ NgramTokenizer

Returns a new instance of NgramTokenizer.

# File 'lib/mini_search/ngram_tokenizer.rb', line 6

def initialize(n)
  @n = n || 2
end

Instance Method Details

#execute(string) ⇒ Object

# File 'lib/mini_search/ngram_tokenizer.rb', line 10

def execute(string)
  # In the future, we may want to consider doing a strip on tokens to remove whitespace.
  string.ngrams(regex: //, n: @n).map(&:join)
end