Long Live Context Engineering - with Jeff Huber of Chroma

In this episode of the Latent Space Podcast, Jeff Huber, founder and CEO of Chroma, discusses the journey of building Chroma, a retrieval engine for AI applications, and its focus on bridging the gap between AI demos and production-ready systems. Huber emphasizes Chroma's commitment to developer experience, highlighting the zero-config, usage-based billing model of Chroma Cloud. The conversation explores the concept of "context engineering," the importance of managing context windows in LLMs, and the challenges of context rot. Huber shares insights on building a strong team, maintaining focus amidst industry hype, and the significance of high-quality, labeled data sets. The episode also touches on the future of retrieval systems, the role of memory in AI, and the importance of having a clear vision and values in building a company.