Skip to main content

Ctrl+K

EasyDeL documentation

Contents:

BaseTrainer Documentation
Trainer Protocol Documentation
EasyDeL Installation and Usage Guide
Contributing to EasyDeL
EasyDeL APIs 🔮
EasyDeL Whisper API Server
EasyDeL vInference API Server
oDrive/oEngine Example
vSurge API Server Example
Direct Preference Optimization (DPO) Trainer
Group Relative Policy Optimization (GRPO) Trainer
Odds Ratio Preference Optimization (ORPO) Trainer
Supervised Fine-Tuning (SFT) Trainer
Reward Model Training
Vision-Language Models
Audio-Language Models
Multimodal Inference Serving
Getting Started with EasyDeL on TPU Research Cloud (TRC)

.rst

Caching

Caching#

easydel.layers.caching.__init__
easydel.layers.caching._abstracts
Lightning
- easydel.layers.caching.lightning.__init__
- easydel.layers.caching.lightning.lightning_cache
Mamba
Mamba2
Paged Attention
Transformer

previous

easydel.layers.attention_operator.modules.vanilla

next

easydel.layers.caching.__init__

By Erfan Zare Chavoshi

© Copyright 2023, Erfan Zare Chavoshi - EasyDeL.