Method List
Classes
Methods
Files
Search:
#decode
Tokenizers::CharBPETokenizer
#encode
Tokenizers::CharBPETokenizer
from_pretrained
Tokenizers
#initialize
Tokenizers::CharBPETokenizer