Method: YARD::Parser::Base#tokenize

Defined in:
lib/yard/parser/base.rb

#tokenize ⇒ Array

This method is abstract.

This method should be implemented to tokenize given source

Returns:

  • (Array) —

    a list/tree of lexical tokens

Raises:

  • (NotImplementedError)

Since:

  • 0.5.6


39
40
41
 
# File 'lib/yard/parser/base.rb', line 39

def tokenize
  raise NotImplementedError, "#{self.class} does not support tokenization"
end