Class: Tokenizers::PreTokenizers::Digits
- Inherits:
-
Object
- Object
- Tokenizers::PreTokenizers::Digits
- Defined in:
- lib/tokenizers/pre_tokenizers/digits.rb
Class Method Summary collapse
Class Method Details
.new(individual_digits: false) ⇒ Object
4 5 6 |
# File 'lib/tokenizers/pre_tokenizers/digits.rb', line 4 def self.new(individual_digits: false) _new(individual_digits) end |