Class: Tokenizers::Decoders::WordPiece
- Inherits:
-
Object
- Object
- Tokenizers::Decoders::WordPiece
- Defined in:
- lib/tokenizers/decoders/word_piece.rb
Class Method Summary collapse
Class Method Details
.new(prefix: '##', cleanup: true) ⇒ Object
4 5 6 |
# File 'lib/tokenizers/decoders/word_piece.rb', line 4 def self.new(prefix: '##', cleanup: true) _new(prefix, cleanup) end |