Generative AI Infrastructure at Lyft

Konstantin Gizdarski from Lyft discusses the Generative AI infrastructure stack at Lyft. The talk covers how existing ML platform components were leveraged for AI applications like model training and serving. It also details novel AI components built by Lyft, including an AI vendor gateway, custom clients, LLM evaluation tools, and PII-preserving infrastructure. Finally, a few use-cases of Generative AI at Lyft are shared.