Class: Tokenizers::Decoders::WordPiece

Inherits:

Object

Object
Tokenizers::Decoders::WordPiece

show all

Defined in:: lib/tokenizers/decoders/word_piece.rb

Class Method Summary collapse

.new(prefix: '##', cleanup: true) ⇒ Object

Class Method Details

.new(prefix: '##', cleanup: true) ⇒ `Object`



4
5
6

# File 'lib/tokenizers/decoders/word_piece.rb', line 4

def self.new(prefix: '##', cleanup: true)
  _new(prefix, cleanup)
end