Class: Dhaka::LexerSupport::RegexTokenizer

Inherits:
Tokenizer
  • Object
show all
Defined in:
lib/dhaka/lexer/regex_tokenizer.rb

Instance Attribute Summary

Attributes inherited from Tokenizer

#tokens

Method Summary

Methods inherited from Tokenizer

#advance, #create_token, #curr_char, #curr_token, for_state, #initialize, #inspect, #run, #switch_to, tokenize

Constructor Details

This class inherits a constructor from Dhaka::Tokenizer