Jonathan Ross, Founder & CEO @ Groq: NVIDIA vs Groq - The Future of Training vs Inference | E1260

Video Description

Jonathan Ross is the Founder & CEO of Groq, the creator of the world’s first Language Processing Unit (LPUTM). Prior to Groq, Jonathan began what became Google’s Tensor Processing Unit (TPU) as a 20% project where he designed and implemented the core elements of the first-generation TPU chip. Jonathan next joined Google X’s Rapid Eval Team, the initial stage of the famed “Moonshots Factory”, where he devised and incubated new Bets (Units) for Google’s parent company, Alphabet. ---------------------------------------------- In Today’s Episode We Discuss: (00:00) Intro (01:29) Scaling Laws and AI Model Training (06:48) Synthetic Data and Model Efficiency (09:00) Inference vs. Training Costs: Why NVIDIA Loses Inference (15:12) The Future of AI Inference: Efficiency and Cost (16:35) Chip Supply and Scaling Concerns (19:40) Energy Efficiency in AI Computation (25:37) Why Most Dollars Into Datacenters Will Be Lost (31:41) Meta, Google, and Microsoft's Data Center Investments (43:24) Distribution of Value in the AI Economy (44:17) Stages of Startup Success (45:46) The AI Investment Bubble (47:45) The Keynesian Beauty Contest in VC (51:52) NVIDIA's Role in the AI Ecosystem (57:30) China's AI Strategy and Global Implications (01:02:25) Europe's Potential in the AI Revolution (01:17:13) Future Predictions and AI's Impact on Society ---------------------------------------------- Subscribe on Spotify: https://open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85bc9196860e4466 Subscribe on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-twenty-minute-vc-20vc-venture-capital-startup/id958230465 Follow Harry Stebbings on Twitter: https://twitter.com/HarryStebbings Follow Jonathan Ross on Twitter: https://twitter.com/JonathanRoss321 Follow 20VC on Instagram: https://www.instagram.com/20vchq Follow 20VC on TikTok: https://www.tiktok.com/@20vc_tok Visit our Website: https://www.20vc.com Subscribe to our Newsletter: https://www.thetwentyminutevc.com/contact ----------------------------------------------- #20vc #harrystebbings #jonathanross #groq #CEO #venturecapital #founder #ai #nvidia #modeltraining #inference