Module: Patterns
- Included in:
- RubyTokenizer::Tokenizer
- Defined in:
- lib/patterns_module/patterns.rb
Constant Summary collapse
- PUNCTUATION =
[':', ',', '—', '!', '?', ';', '"']
- PARENS =
['{', '[', '}', ']', '(', ')']
- MISC =
['<', '«', '„', '>', '»', '“', '*']
- BASIC =
CONJUNCTIONS = [‘for ’, ‘and ’, ‘nor ’, ‘but ’, ‘or ’, ‘yet ’, ‘so ’, ‘as ’] DETERMINERS = [‘the ’, ‘this ’, ‘that ’]
PUNCTUATION + PARENS + MISC
Class Method Summary collapse
Class Method Details
.basic ⇒ Object
10 11 12 |
# File 'lib/patterns_module/patterns.rb', line 10 def self.basic Regexp.union(BASIC) end |