Poker Pros React to AI Models Playing Heads-Up Poker | Doug Polk & Liv Boeree

Video Description

Which AI Model is best at POKER? There's a huge project going on this week that tests all the biggest language models, like ChatGPT, Gemini, Claude and Grok at Headsup NL Texas Holdem. This week I'm collaborating with @kaggle and @googledeepmind to explain their new “AI Game Arena” project, designed to test all the top LLMs at various games. The Game Arena is a massive research project to create new AI benchmarks, and understand what really makes these general-purpose AIs tick. It also helps us evaluate how far along the path to true AGI we are, NBD. So who better to speak to than the king of heads up poker: @DougPolkPoker who has been making a bunch of hand analysis videos over on his channel (go watch them). Together with my occasional co-host Igor, we learn which bots are good, bad, and downright insane at the game. Also, some speculation on whether they reflect the personality of their parent companies, why they can't read flushes, and a bunch of other game adjacent lols. If you love poker and AI, this is absolutely a no-miss coversation. Chapters: 00:00 - Intro 01:00 — LLMs vs Libratus and Claudico 02:35 — Why The Bots' Reasoning Sounds Reasonable But Really Isn't 04:31 — Do They Actually Understand What's Happening? 08:41 — The Flushes Problem 13:23 — The Context Window Problem 23:18 — The Models as Player Types 24:30 — Grok’s Playing Style 24:58 — Claude’s Playing Style 25:20 — Do AI Models Reflect Their Builders? Links: ♾️ Kaggle Game Arena (Main Hub): https://www.kaggle.com/game-arena ♾️ Doug Polk: https://www.dougpolk.com ♾️ Doug Polk YouTube: https://www.youtube.com/@DougPolkPoker ♾️ Poker Benchmark – 900,000 Hands: https://www.kaggle.com/blog/game-arena-poker ♾️ Werewolf Benchmark (Social Deception Game): https://www.kaggle.com/benchmarks/kaggle/werewolf ♾️ Google DeepMind (Research Organization): https://deepmind.google ♾️ Polaris Library (DeepMind, Open Source): https://github.com/google-deepmind/polaris ♾️ Claudico (Poker AI): https://www.cs.cmu.edu/news/2015/claudico ♾️ Libratus (Poker AI): https://www.cs.cmu.edu/news/2017/libratus ♾️ Carnegie Mellon Poker AI: https://www.cs.cmu.edu/~noamb/papers/17-IJCAI-poker.pdf ♾️ Two Plus Two Poker Forum: https://forumserver.twoplustwo.com Credits: ♾️ Hosted by Liv Boeree ♾️ Produced by Luca de Vico The Win-Win Podcast: Poker champion Liv Boeree takes to the interview chair to tease apart the complexities of one of the most fundamental parts of human nature: competition. Liv is joined by top philosophers, gamers, artists, technologists, CEOs, scientists, politicians and more to understand how competition manifests in their world, and how to change seemingly win-lose systems into Win-Wins. Podcast links: ♾️ Website: https://www.winwinpodcast.com/ ♾️ Youtube: https://www.youtube.com/playlist?list=PLWgq0OZMtwtOIyMsVM_vksqdfWcM-b68S ♾️ Spotify: https://open.spotify.com/show/03bGVUaFZmJUmEvSHNDPdI?si=64379cc23696454f ♾️ Apple Podcasts: https://podcasts.apple.com/us/podcast/win-win-with-liv-boeree/id1724791350 ♾️ Pocketcast: https://play.pocketcasts.com/podcasts/7f708340-d17c-013b-f46e-0acc26574db2 #winwinpodcast #ai #poker #kaggle