Modules

• easydel.layers.attention_operator.modules.__init__
  • FlashAttn
  • RingAttn
  • ScaledDotProductAttn
  • SplashAttn
  • VanillaAttn
• easydel.layers.attention_operator.modules.flash
  • FlashAttn
• easydel.layers.attention_operator.modules.ring
  • Carry
  • RingAttn
  • blockwise_attn()
• easydel.layers.attention_operator.modules.scaled_dot_product
  • ScaledDotProductAttn
• easydel.layers.attention_operator.modules.splash
  • SplashAttn
• easydel.layers.attention_operator.modules.vanilla
  • VanillaAttn