Class: HH::Syntax::Default
Overview
A default tokenizer for handling syntaxes that are not explicitly handled elsewhere. It simply yields the given text as a single token.
Instance Method Summary collapse
-
#tokenize(text) {|Token.new( text, :normal )| ... } ⇒ Object
Yield the given text as a single token.
Instance Method Details
#tokenize(text) {|Token.new( text, :normal )| ... } ⇒ Object
Yield the given text as a single token.
168 169 170 |
# File 'lib/ext/highlighter/common.rb', line 168 def tokenize( text ) yield Token.new( text, :normal ) end |