The Power of Local AI

Christian Crowley, Co-Founder of Sanctum AI, discusses the growing importance of private AI and introduces Sanctum, an application that allows users to run full-featured, open-source LLMs locally on their Mac or PC. The talk highlights the trade-offs between local and server-based AI, the benefits of open-source models, and practical applications for fields like legal, finance, academia, content creation, and development. Sanctum aims to make accessing leading open-source language models in an encrypted, local environment as easy as possible, especially for fine-tuning on sensitive data.