Skip to main content
Back to top
Ctrl
+
K
EasyDeL documentation
Getting Started
Installing EasyDeL
Contributing to EasyDeL
EasyDeLState: A Snapshot of Your EasyDeL Model
APIs
EasyDeL APIs 🔮
Cli
cli package
train.clm package
train.dpo package
train.sft package
utils package
Etils
etils package
errors package
partition_module package
easystate package
auto_tx package
Inference
logits_process package
whisper_inference package
utils package
vinference.api_client package
vinference.api_server package
vinference.metrics package
vinference.api_server_test package
vinference.api_id_generator package
vinference.vinference package
vinference.api_models package
Kernels
flash_attention_2 package
rms_norm package
tpu_ops.pallas_gemm package
tpu_ops.pallas_ring_attention package
cpu_ops.jax_ring_attention package
cpu_ops.jax_mha_flash_attention_2 package
utils package
gpu_ops.triton_gemm package
gpu_ops.pallas_gqa_flash_attention_2 package
gpu_ops.triton_gqa_flash_attention_2 package
gpu_ops.pallas_gemm package
gpu_ops.pallas_mha_flash_attention_2 package
ring_attention package
gemm package
Layers
rotary_embedding_test package
rotary_embedding package
norms package
attention package
_blockwise_attention package
common package
Modules
opt.opt_configuration package
opt.modelling_opt_flax package
gpt_j.gpt_j_configuration package
gpt_j.modeling_gpt_j_flax package
internlm2.internlm2_configuration package
internlm2.modeling_internlm2_flax package
llama.llama_configuration package
llama.modeling_llama_flax package
roberta.modelling_roberta_flax package
roberta.roberta_configuration package
mamba2.modelling_mamba2_flax package
mamba2.mamba2_configuration package
mistral.modelling_mistral_flax package
mistral.mistral_configuration package
auto_modeling package
mamba.modelling_mamba_flax package
mamba.mamba_configuration package
gpt_neo_x.gpt_neo_x_configuration package
gpt_neo_x.modeling_gpt_neo_x_flax package
dbrx.dbrx_configuration package
dbrx.modelling_dbrx_flax package
rwkv.rwkv_configuration package
rwkv.modelling_rwkv_flax package
mixtral.mixtral_configuration package
mixtral.modelling_mixtral_flax package
arctic.arctic_configuration package
arctic.modelling_arctic_flax package
zamba2.zamba2_configuration package
zamba2.modeling_zamba2_flax package
falcon.falcon_configuration package
falcon.modeling_falcon_flax package
phimoe.phimoe_configuration package
phimoe.modeling_phimoe_flax package
modeling_utils package
qwen2_moe.configuration_qwen2_moe package
qwen2_moe.modeling_qwen2_moe_flax package
t5.modelling_t5_flax package
t5.t5_configuration package
modeling_flax_outputs package
mosaic_mpt.modelling_mpt_flax package
mosaic_mpt.mosaic_configuration package
stablelm.modelling_stablelm_flax package
stablelm.stablelm_configuration package
xerxes.modeling_xerxes_flax package
xerxes.xerxes_configuration package
phi3.modelling_phi3_flax package
phi3.phi3_configuration package
auto_speech_seq2seq_model package
factory package
exaone.modeling_exaone_flax package
exaone.exaone_configuration package
gpt2.gpt2_configuration package
gpt2.modeling_gpt2_flax package
auto_configuration package
grok_1.grok_1_configuration package
grok_1.modeling_grok_1_flax package
qwen2.modeling_qwen_flax package
qwen2.qwen_configuration package
chatglm.chatglm_configuration package
chatglm.modelling_chatglm_flax package
phi.modelling_phi_flax package
phi.phi_configuration package
whisper.whisper_configuration package
whisper.modelling_whisper_flax package
flax_modeling_utils package
gemma2.modeling_gemma2_flax package
gemma2.gemma2_configuration package
olmo.modeling_olmo_flax package
olmo.olmo_configuration package
auto_causal_language_model package
cohere.cohere_configuration package
cohere.modelling_cohere_flax package
gemma.gemma_configuration package
gemma.modeling_gemma_flax package
deepseek_v2.modeling_deepseek_flax package
deepseek_v2.deepseek_configuration package
palm.modelling_palm_flax package
palm.palm_configuration package
openelm.openelm_configuration package
openelm.modelling_openelm_flax package
olmo2.olmo2_configuration package
olmo2.modeling_olmo2_flax package
Smi
smi package
Trainers
odds_ratio_preference_optimization_trainer.modelling_output package
odds_ratio_preference_optimization_trainer.orpo_config package
odds_ratio_preference_optimization_trainer.fwd_bwd_functions package
odds_ratio_preference_optimization_trainer.orpo_trainer package
vision_causal_language_model_trainer.modelling_output package
vision_causal_language_model_trainer.functions package
vision_causal_language_model_trainer.vision_causal_language_model_trainer package
sequence_classification_trainer.sequence_classification_trainer package
sequence_classification_trainer.functions package
sequence_classification_trainer.modeling_output package
causal_language_model_trainer.functions package
causal_language_model_trainer.modeling_output package
causal_language_model_trainer.causal_language_model_trainer package
training_configurations package
utils package
packer package
prompt_utils package
supervised_fine_tuning_trainer.utils package
supervised_fine_tuning_trainer.stf_trainer package
direct_preference_optimization_trainer.modelling_output package
direct_preference_optimization_trainer.dpo_trainer package
direct_preference_optimization_trainer.dpo_config package
direct_preference_optimization_trainer.func_utils.loss_funcs package
direct_preference_optimization_trainer.func_utils.concatenators package
direct_preference_optimization_trainer.func_utils.creators package
direct_preference_optimization_trainer.func_utils.log_probs package
direct_preference_optimization_trainer.utils package
sequence_to_sequence_trainer.functions package
sequence_to_sequence_trainer.sequence_to_sequence_trainer package
sequence_to_sequence_trainer.modeling_output package
sequence_to_sequence_trainer.datacollectors package
base_trainer package
Transform
parameters_transformation package
utils package
Utils
readme_generator package
compiling_utils package
analyze_memory package
lazy_import package
quantizers package
helpers package
Examples
FlexibleAttentionModule: A Versatile Attention Mechanism Factory
Training a Causal Language Model with EasyDeL
EasyDeL Tutorial
Supervised Fine-Tuning with SFTTrainer
GPU and TPU Inference with EasyDeL
.rst
.pdf
vinference.vinference package
vinference.vinference package
#