Lessons Learned: The Journey to Real-Time Machine Learning at Instacart
39 min

Lessons Learned: The Journey to Real-Time Machine Learning at Instacart

MLOps World - MLOps World & Generative AI World 2024
Guanghua Shu
real-time-ml instacart online-inference streaming-infrastructure flink recommendation-systems machine-learning ml-platform feature-store model-serving kafka data-modeling
Wanted: A Silver Bullet MLOps Solution for Enterprise
31 min

Wanted: A Silver Bullet MLOps Solution for Enterprise

MLOps World - MLOps World & Generative AI World 2024
Muller Mu Christophe Chabbert
enterprise-mlops pipeline-orchestration conway-law api-first modular-architecture mlops machine-learning drug-discovery data-science model-deployment observability
Evaluation Techniques for Large Language Models
1h 41m

Evaluation Techniques for Large Language Models

MLOps World - MLOps World & Generative AI World 2024
Rajiv Shah
functional-correctness similarity-metrics large-language-models llm ai machine-learning benchmarking nlp natural-language-processing hugging-face prompt-engineering
Customizable RAG Workflows with your Own Data
40 min

Customizable RAG Workflows with your Own Data

MLOps World - MLOps World & Generative AI World 2024
Christy Bergman
milvus zilliz semantic-similarity rag generative-ai llm vector-databases langchain hugging-face embeddings retrieval-augmented-generation data-modeling
Evaluation Engineering: Iterative Strategies to Testing Prompts
29 min

Evaluation Engineering: Iterative Strategies to Testing Prompts

MLOps World - MLOps World & Generative AI World 2024
Jared Zoneraich
evaluation-engineering backtesting regression-testing prompt-engineering testing test-driven-development ai machine-learning llm natural-language-processing
LLMs From Dream to Deployed
29 min

LLMs From Dream to Deployed

MLOps World - MLOps World & Generative AI World 2024
Josh Goldstein
chatbots seldon llm large-language-models machine-learning mlops deployment retrieval-augmented-generation rag kubernetes openai hugging-face gpu
Mitigating RAG Hallucinations with Aporia Guardrails
25 min

Mitigating RAG Hallucinations with Aporia Guardrails

MLOps World - MLOps World & Generative AI World 2024
rag retrieval-augmented-generation llm large-language-models ai artificial-intelligence hallucinations guardrails data-quality natural-language-processing
Introducing Arize-Phoenix and OpenInference
43 min

Introducing Arize-Phoenix and OpenInference

MLOps World - MLOps World & Generative AI World 2024
Mikyo King
ai-observability llama-index openai generative-ai llm rag open-source tracing language-models python
Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications
46 min

Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications

MLOps World - MLOps World & Generative AI World 2024
Dhruv Singh
ai-applications llm-evaluators generative-ai genai llm large-language-models testing enterprise-ai reliability guardrails human-evaluation
Running Multiple Models on the Same GPU, on Spot Instances
33 min

Running Multiple Models on the Same GPU, on Spot Instances

MLOps World - MLOps World & Generative AI World 2024
Oscar Rovira
ml-inference spot-instances gpu-fractionalization gpu cost-optimization generative-ai llm cloud-computing aws gcp azure mlops
The Secret Sauce for Deploying LLM Applications into Production
32 min

The Secret Sauce for Deploying LLM Applications into Production

MLOps World - MLOps World & Generative AI World 2024
Josh Reini
evaluation-frameworks truelens ai-adoption llm generative-ai production-deployment rag langchain evaluation-data model-monitoring observability enterprise-ai
The Journey of Building a Leading Open Source LLM Security Toolkit
32 min

The Journey of Building a Leading Open Source LLM Security Toolkit

MLOps World - MLOps World & Generative AI World 2024
Oleksandr Yaremchuk
protect-ai llm-guard jailbreak cybersecurity machine-learning-security llm llm-security open-source prompt-injection data-leakage prompt-engineering ai-security