Vector databases and the $8 trillion open source market | Bob van Luijt, CEO of Weaviate

Video Description

In this episode, we sat down with Bob van Luijt (https://twitter.com/bobvanluijt), the CEO of Weaviate, diving into the cutting-edge world of vector databases and their role in the AI revolution. Weaviate is an open source, AI-native vector database that helps developers create intuitive and reliable AI-powered applications. Weaviate sets itself apart with its vector search engine that integrates machine learning directly into its core, enabling more nuanced and context-aware search capabilities for AI-driven applications. This conversation explores vector databases (the core infrastructure behind generative models), and the role of Retrieval-Augmented Generation (RAG). We also explore how open source is driving commercial use cases. WEAVIATE Website - https://weaviate.io Twitter - https://twitter.com/weaviate_io Bob van Luijt (Co-Founder & Co-CEO): LinkedIn - https://www.linkedin.com/in/bobvanluijt Twitter - https://twitter.com/bobvanluijt Matt Turck: LinkedIn - https://www.linkedin.com/in/turck/ Twitter - https://twitter.com/mattturck DATA DRIVEN NYC This episode of the MAD Podcast was recorded live at Data Driven NYC, an event series organized by FirstMark Capital. The events are free and held monthly in New York, currently with the support of Foursquare. If you wish to attend and be notified of future events, please follow FirstMark on Eventbrite at https://www.eventbrite.com/o/firstmark-capital-2215570183 WATCH AND LISTEN ON: Apple Podcasts: https://podcasts.apple.com/us/podcast/vector-databases-and-the-future-of-ai/id1686238724?i=1000645455458 Spotify: https://open.spotify.com/episode/11BwLU15AYAstYE6WGktkJ?si=f46653fcde514b47 00:00 Intro 01:18 What is RAG? 06:47 Why is embedding models is such a hot topic right now? 08:33 What is your assessment of RAG? 10:03 Generative feedback loops 12:13 What is Hybrid Search? 15:42 What makes Weaviate special? 17:20 What about security? 18:12 Does RAG accelerated the need for real-time data? 19:54 How to define good vector database? 22:38 What do you think about general purpose databases entering the field of vector-based databases? 24:14 Interesting use cases of Weaviate 25:54 What’s your sense of the current state of the market? 27:20 Open source vs commercial product on Weaviate 29:50 How did it all started?