Class: Dhaka::LexerSupport::RegexTokenizer

Inherits:

Tokenizer

• Object
• Tokenizer
• Dhaka::LexerSupport::RegexTokenizer

Defined in:

lib/dhaka/lexer/regex_tokenizer.rb

Instance Attribute Summary

Attributes inherited from Tokenizer

#tokens

Method Summary

Methods inherited from Tokenizer

#advance, #create_token, #curr_char, #curr_token, for_state, #initialize, #inspect, #run, #switch_to, tokenize

Constructor Details

This class inherits a constructor from Dhaka::Tokenizer