Class: Tokenizers::PreTokenizers::Punctuation
- Inherits:
-
Object
- Object
- Tokenizers::PreTokenizers::Punctuation
- Defined in:
- lib/tokenizers/pre_tokenizers/punctuation.rb
Class Method Summary collapse
Class Method Details
.new(behavior: "isolated") ⇒ Object
4 5 6 |
# File 'lib/tokenizers/pre_tokenizers/punctuation.rb', line 4 def self.new(behavior: "isolated") _new(behavior) end |