easydel.layers.attention_operator.modules.vanilla#
- class easydel.layers.attention_operator.modules.vanilla.VanillaAttn(metadata: AttentionMetadata)[source]#
Bases:
AttentionImpl- forward_cpu(*args, **kwargs) AttentionOutput[source]#
- forward_cuda(*args, **kwargs) AttentionOutput[source]#
- forward_gpu(*args, **kwargs) AttentionOutput[source]#
- forward_native(q: Array, k: Array, v: Array, mask: Optional[Array] = None, bias: Optional[Array] = None, init_bias: Optional[Callable[[], Array]] = None, deterministic: bool = False, dropout_rng: Optional[PRNGKey] = None, **ignore) AttentionOutput[source]#
- forward_rocm(*args, **kwargs) AttentionOutput[source]#
- forward_tpu(*args, **kwargs) AttentionOutput[source]#
- get_impl_metadata() AttentionMetadata[source]#