Inference#
- easydel.inference.__init__
- easydel.inference.logits_process
EmptyProcessorForceTokensLogitsProcessorForcedBOSTokenLogitsProcessorForcedEOSTokenLogitsProcessorFrequencyPenaltyLogitsProcessorLogitsProcessorLogitsProcessorListLogitsWarperMinLengthLogitsProcessorMinPLogitsWarperNoRepeatNGramLogitsProcessorPresencePenaltyLogitsProcessorRepetitionPenaltyLogitsProcessorSuppressTokensAtBeginLogitsProcessorSuppressTokensLogitsProcessorTemperatureLogitsWarperTopKLogitsWarperTopPLogitsWarperWhisperTimeStampLogitsProcessoradd_start_docstrings()
- easydel.inference.openai_api_modules
ChatCompletionRequestChatCompletionResponseChatCompletionResponseChoiceChatCompletionStreamResponseChatCompletionStreamResponseChoiceChatMessageCompletionLogprobsCompletionRequestCompletionResponseCompletionResponseChoiceCompletionStreamResponseCompletionStreamResponseChoiceCountTokenRequestDeltaMessageFunctionDefinitionToolDefinitionUsageInfo
- easydel.inference.utilities
- Vinference
- Vsurge
- Vwhisper