Introducing Arize-Phoenix and OpenInference
43 min

Introducing Arize-Phoenix and OpenInference

MLOps World - MLOps World & Generative AI World 2024
Mikyo King
ai-observability llama-index openai generative-ai llm rag open-source tracing language-models python
Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications
46 min

Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications

MLOps World - MLOps World & Generative AI World 2024
Dhruv Singh
ai-applications llm-evaluators generative-ai genai llm large-language-models testing enterprise-ai reliability guardrails human-evaluation
Running Multiple Models on the Same GPU, on Spot Instances
33 min

Running Multiple Models on the Same GPU, on Spot Instances

MLOps World - MLOps World & Generative AI World 2024
Oscar Rovira
ml-inference spot-instances gpu-fractionalization gpu cost-optimization generative-ai llm cloud-computing aws gcp azure mlops
The Secret Sauce for Deploying LLM Applications into Production
32 min

The Secret Sauce for Deploying LLM Applications into Production

MLOps World - MLOps World & Generative AI World 2024
Josh Reini
evaluation-frameworks truelens ai-adoption llm generative-ai production-deployment rag langchain evaluation-data model-monitoring observability enterprise-ai
The Journey of Building a Leading Open Source LLM Security Toolkit
32 min

The Journey of Building a Leading Open Source LLM Security Toolkit

MLOps World - MLOps World & Generative AI World 2024
Oleksandr Yaremchuk
protect-ai llm-guard jailbreak cybersecurity machine-learning-security llm llm-security open-source prompt-injection data-leakage prompt-engineering ai-security
The Power of Local AI
37 min

The Power of Local AI

MLOps World - MLOps World & Generative AI World 2024
Christian Crowley
local-ai private-ai open-source-models personalization sanctum-ai artificial-intelligence large-language-models llm privacy security hugging-face data-privacy
Enhance Cost Efficiency in Domain Adaptation with PruneMe
17 min

Enhance Cost Efficiency in Domain Adaptation with PruneMe

MLOps World - MLOps World & Generative AI World 2024
Shamane Siri
domain-adaptation continual-pretraining ai-research llm large-language-models pruning cost-efficiency model-optimization transformer nlp
Empowering Data Science Teams: Harnessing AI with Appen
31 min

Empowering Data Science Teams: Harnessing AI with Appen

MLOps World - MLOps World & Generative AI World 2024
Sasha McGrath Geoffrey LaPorte
training-data ai data-science machine-learning llm generative-ai data-annotation data-quality collaboration model-building
Evaluating LLMs and RAG Pipelines at Scale
36 min

Evaluating LLMs and RAG Pipelines at Scale

MLOps World - MLOps World & Generative AI World 2024
Eric Korman
valor llm rag mlops llm-ops pipelines language-models natural-language-processing data-management model-training model-deployment
Function Calling for LLMs: RAG without a Vector Database
40 min

Function Calling for LLMs: RAG without a Vector Database

MLOps World - MLOps World & Generative AI World 2024
Jim Dowling
feature-store llm rag function-calling vector-database ai data-modeling natural-language-processing retrieval-augmented-generation api machine-learning
LLM Fine-Tuning for Modern AI Teams: How One E-Commerce Unicorn Cut Inference Cost by 90%
47 min

LLM Fine-Tuning for Modern AI Teams: How One E-Commerce Unicorn Cut Inference Cost by 90%

MLOps World - MLOps World & Generative AI World 2024
Emmanuel Turlay
inference-cost data-preparation mistral-7b gpt-3.5 cost-reduction llm fine-tuning ai machine-learning e-commerce natural-language-processing model-evaluation
From Idea to Production: AI Infra for Scaling LLM Apps
39 min

From Idea to Production: AI Infra for Scaling LLM Apps

MLOps World - MLOps World & Generative AI World 2024
Guy Eshet
llm ai ai-infrastructure llm-ops prompt-engineering model-deployment gpu data-pipelines rag cost-optimization generative-ai llm-applications