Class: Tokenizers::Models::Unigram
- Inherits:
-
Object
- Object
- Tokenizers::Models::Unigram
- Defined in:
- lib/tokenizers/models/unigram.rb
Class Method Summary collapse
Class Method Details
.new(vocab: nil, unk_id: nil, byte_fallback: nil) ⇒ Object
4 5 6 |
# File 'lib/tokenizers/models/unigram.rb', line 4 def self.new(vocab: nil, unk_id: nil, byte_fallback: nil) _new(vocab, unk_id, byte_fallback) end |