Introducing Arize-Phoenix and OpenInference

May 16, 2024 43 min Free

Description

As teams race to incorporate generative AI in their applications, the need for observability and evaluation is critical. This talk introduces OpenInference, a new open set of plugins and conventions that enables tracing of AI applications, and Arize-Phoenix, a platform that offers AI evaluation and observability. The presentation includes practical guidance for practitioners, such as how to incorporate LLMs as a judge to guard against hallucinations and poor retrieval, and a demo of Phoenix through real-world examples and use cases.