Class: Tokenizers::PreTokenizers::Punctuation

Inherits:

Object

Object
Tokenizers::PreTokenizers::Punctuation

show all

Defined in:: lib/tokenizers/pre_tokenizers/punctuation.rb

Class Method Summary collapse

.new(behavior: "isolated") ⇒ Object

Class Method Details

.new(behavior: "isolated") ⇒ `Object`



4
5
6

# File 'lib/tokenizers/pre_tokenizers/punctuation.rb', line 4

def self.new(behavior: "isolated")
  _new(behavior)
end