Run AI Models with Docker - No Setup, No Headaches

Video Description

What is Docker Model Runner and why should you care? Docker’s new Model Runner makes it easy to run and develop with AI models, no messy dependencies or complicated setup. In this video, I’ll walk you through everything from getting started in the CLI, using it with Docker Compose, and developing locally with my open-source Next.js app techno-boto-chat. Big thanks to Docker for sponsoring this video Try Docker Model Runner for free: https://dockr.ly/4nOGjdm Download Docker Desktop: https://dockr.ly/4nQHOYq Video Notes: https://technotim.live/posts/docker-model-runner/ Merch Shop 🛍️: https://l.technotim.live/shop Support me on Patreon: https://www.patreon.com/technotim Sponsor me on GitHub: https://github.com/sponsors/timothystewart6 Subscribe on Twitch: https://www.twitch.tv/technotim Become a YouTube member: https://www.youtube.com/channel/UCOk-gHyjcWZNj3Br4oxwh0A/join Gear Recommendations: https://l.technotim.live/gear Get Help in Our Discord Community: https://l.technotim.live/discord 2nd channel: https://www.youtube.com/@TechnoTimTinkers (Affiliate links may be included in this description. I may receive a small commission at no cost to you.) 00:00 - Intro: Why Docker Model Runner? 01:15 - What Is Docker Model Runner? 02:05 - Getting Started (CLI Basics) 03:47 - Using Docker Model Runner with Compose 04:30 - OpenWebUI with Docker Model Runner 05:54 - Developing locally with my techno-boto-chat 08:15 - Starting and configuring the application 10:07 - Running the application with NodeJS 11:59 - Docker Model Runner logging and debugging 14:10 - Running techno-boto-chat with Docker Compose 16:31 - Outro & Final Thoughts Thank you for watching!