Serving GenAI Workloads At Scale With LitServe
41 min

Serving GenAI Workloads At Scale With LitServe

MLOps World - MLOps World & Generative AI World 2024
Aniket Maurya
lit-serve pytorch-lightning api-serving dynamic-batching genai ai llm python autoscaling rag openai-api docker