Why AI Apps Don't Work in Prod: AI Reliability Survey

Despite the initial frenzy around the impact of AI on software projects, the actualized impact remains limited. This is in large part because AI has inherent variability which makes engineering orgs stumped with the dreaded question "how do I know it won't break in prod even though it works in dev". In this talk, Shreya will cover why reliability for AI engineering is hard, a survey of techniques for improving reliability and lessons from solving reliability for AI engineering for the last 18 months.