Class: Informers::M2M100ForConditionalGeneration
- Inherits:
-
M2M100PreTrainedModel
- Object
- PreTrainedModel
- M2M100PreTrainedModel
- Informers::M2M100ForConditionalGeneration
- Defined in:
- lib/informers/models.rb
Constant Summary
Constants inherited from PreTrainedModel
PreTrainedModel::MAIN_INPUT_NAME
Instance Attribute Summary
Attributes inherited from PreTrainedModel
Instance Method Summary collapse
-
#initialize(config, session, decoder_merged_session, generation_config) ⇒ M2M100ForConditionalGeneration
constructor
A new instance of M2M100ForConditionalGeneration.
Methods inherited from PreTrainedModel
#call, construct_session, from_pretrained, #generate
Constructor Details
#initialize(config, session, decoder_merged_session, generation_config) ⇒ M2M100ForConditionalGeneration
Returns a new instance of M2M100ForConditionalGeneration.
903 904 905 906 907 908 909 910 911 912 913 914 915 |
# File 'lib/informers/models.rb', line 903 def initialize(config, session, decoder_merged_session, generation_config) super(config, session) @decoder_merged_session = decoder_merged_session @generation_config = generation_config @num_decoder_layers = @config["decoder_layers"] @num_decoder_heads = @config["decoder_attention_heads"] @decoder_dim_kv = @config["d_model"] / @num_decoder_heads.to_f @num_encoder_layers = @config["encoder_layers"] @num_encoder_heads = @config["encoder_attention_heads"] @encoder_dim_kv = @config["d_model"] / @num_encoder_heads.to_f end |