Serving GenAI Workloads At Scale With LitServe
41 min

Serving GenAI Workloads At Scale With LitServe

MLOps World - MLOps World & Generative AI World 2024
Aniket Maurya
lit-serve pytorch-lightning api-serving dynamic-batching genai ai llm python autoscaling rag openai-api docker
Creating our own Private OpenAI API
29 min

Creating our own Private OpenAI API

MLOps World - MLOps World & Generative AI World 2024
Meryem Arik Hannes Hapke
large-language-models llms private-api openai-api self-hosting mlops generative-ai inference-optimization quantization gpu-utilization api-gateway kubernetes