easydel.inference.vinference.api_server.api_id_generator#
Provides thread-safe ID generation for API requests.
- class easydel.inference.vinference.api_server.api_id_generator.ReqIDGenerator[source]#
Bases:
objectA thread-safe generator for unique request IDs.
This class ensures that each generated ID is unique even when accessed concurrently from multiple threads. It increments the ID by 8 each time to potentially group related sub-requests.
- easydel.inference.vinference.api_server.api_id_generator.convert_sub_id_to_group_id(sub_req_id: int) int[source]#
Converts a sub-request ID (generated by ReqIDGenerator) back to its associated group ID.
Since the generator increments by 8, this effectively finds the base ID for a group of up to 8 related requests.
- Parameters
sub_req_id (int) – The ID generated for a specific sub-request.
- Returns
The group ID associated with the sub-request ID.
- Return type
int