Class: Transformers::ConvertSlowTokenizer::Converter

Inherits:
Object
  • Object
show all
Defined in:
lib/transformers/convert_slow_tokenizer.rb

Direct Known Subclasses

BertConverter

Instance Method Summary collapse

Constructor Details

#initialize(original_tokenizer) ⇒ Converter

Returns a new instance of Converter.



18
19
20
# File 'lib/transformers/convert_slow_tokenizer.rb', line 18

def initialize(original_tokenizer)
  @original_tokenizer = original_tokenizer
end

Instance Method Details

#convertedObject

Raises:

  • (NotImplementedError)


22
23
24
# File 'lib/transformers/convert_slow_tokenizer.rb', line 22

def converted
  raise NotImplementedError
end