A Practical Guide to Efficient AI

In this talk, Dr. Shelby Heinecke, Senior AI Research Manager at Salesforce, explores key sources of inefficiency in AI models and discusses practical techniques and tools to improve efficiency. Topics covered include model architecture selection, quantization, and prompt optimization. The presentation highlights the importance of efficient AI for deploying models at scale in resource-constrained environments, from cloud to on-device, and showcases advancements in small language models and function calling capabilities.