Class: Transformers::Distilbert::DistilBertFlashAttention2

Inherits:

MultiHeadSelfAttention

Object
Torch::NN::Module
MultiHeadSelfAttention
Transformers::Distilbert::DistilBertFlashAttention2

show all

Defined in:: lib/transformers/models/distilbert/modeling_distilbert.rb

Method Summary

Methods inherited from MultiHeadSelfAttention

#forward, #initialize, #prune_heads

Constructor Details

This class inherits a constructor from Transformers::Distilbert::MultiHeadSelfAttention