Introducing Arize-Phoenix and OpenInference
May 16, 2024
43 min
Free
ai-observability
llama-index
openai
generative-ai
llm
rag
open-source
tracing
language-models
python
Description
As teams race to incorporate generative AI in their applications, the need for observability and evaluation is critical. This talk introduces OpenInference, a new open set of plugins and conventions that enables tracing of AI applications, and Arize-Phoenix, a platform that offers AI evaluation and observability. The presentation includes practical guidance for practitioners, such as how to incorporate LLMs as a judge to guard against hallucinations and poor retrieval, and a demo of Phoenix through real-world examples and use cases.