Host Your Own AI Code Assistant with Docker, Ollama and Continue!

Wolfgang's Channel August 24, 2024
Video Thumbnail
Wolfgang's Channel Logo

Wolfgang's Channel

@wolfgangschannel

About

Hi! My name is Wolfgang and I make videos about tech, Linux and computers. Angaben gemäß § 5 TMG: Wolfgang's Channel c/o IP-Management 24231 Ludwig-Erhard-Str. 18 20459 Hamburg

Video Description

Download Docker Desktop: https://dockr.ly/4fWhlFm Learn more about Docker Scout: https://dockr.ly/3MhG5dE This video is sponsored by Docker Ollama docker-compose file: https://gist.github.com/notthebee/1dfc5a82d13dd2bb6589a1e4747e03cf Docker installation on Debian: https://docs.docker.com/engine/install/debian/ Follow me: Mastodon https://tilde.zone/@notthebee GitHub https://github.com/notthebee Twitch https://twitch.com/notthebeee Support the channel: Patreon https://patreon.com/WolfgangsChannel YouTube Members https://www.youtube.com/channel/UCsnGwSIHyoYN0kiINAGUKxg/join Ko-fi (one time donation) https://ko-fi.com/wolfgangschannel Videos are edited with Davinci Resolve Studio. I use Affinity Photo for thumbnails and Ableton Live for audio editing. Video gear: Camera https://geni.us/IdnhpP (Amazon) Main lens https://geni.us/MF3Ej (Amazon) Secondary camera https://geni.us/aQ3l (Amazon) Secondary lens https://geni.us/jh0Oy7Y (Amazon) Microphone https://geni.us/tgiSqL (Amazon) Key light https://geni.us/Gi1zE2 (Amazon) Softbox https://geni.us/F86pM (Amazon) Secondary light https://geni.us/aciv (Amazon) Other stuff that I use: Monitor https://geni.us/KUzcmcP (Amazon) Monitor arm https://geni.us/Ei4x (Amazon) Laptop stand https://geni.us/hG7Y39 (Amazon) Keyboard https://geni.us/KSR6En (Amazon) Mouse https://geni.us/JpQG (Amazon) Audio interface https://geni.us/sdhWsC (Amazon) As an Amazon Associate, I earn from qualifying purchases Timestamps 00:00 Introduction 01:15 Hardware setup(s) 04:07 Software setup 06:08 Setting up Ollama 08:18 Docker Scout 09:20 Setting up Ollama (cont.) 09:44 Testing the LLMs in Open WebUI 10:41 Testing the code auto-completion 12:00 Power consumption 13:14 Setting up Ollama on the mini PC 14:11 Testing Open WebUI on the mini PC 15:14 Testing the code assistance on the mini PC 16:27 Outro

AI Coding Setup Essentials

AI-recommended products based on this video

Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

(203)
$670.57$399.99
FREE delivery Feb 23 - 27
Loading...
Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black

Corsair MP600 PRO LPX 4TB M.2 NVMe PCIe x4 Gen4 SSD - Optimized for PS5 (Up to 7,100MB/sec Sequential Read & 6,800MB/sec Sequential Write Speeds, High-Speed Interface, Compact Form Factor) Black

(8,521)
$449.99
FREE delivery Tue, Jun 17
Loading...
WYZE Cam v4, 2.5K HD WiFi Smart Home Security Camera, Indoor/Outdoor, Pet/Baby Monitor, Motion Activated Spotlight/Siren, Color Night Vision, 2-Way Audio, Works with Alexa & Google, Wired, Grey

WYZE Cam v4, 2.5K HD WiFi Smart Home Security Camera, Indoor/Outdoor, Pet/Baby Monitor, Motion Activated Spotlight/Siren, Color Night Vision, 2-Way Audio, Works with Alexa & Google, Wired, Grey

(6,464)
$49.98$40.43
PrimeFREE delivery Sat, Jun 14
400+ bought in past month
Loading...
KOORUI 24 Inch IPS Gaming Monitor, FHD 1920×1080p, 165Hz 200Hz Monitors, 1ms with Adaptive Sync, DCI-P3 90% Color Gamut, HDR400, 2 x HDMI 2.0, DisplayPort 1.4, Tilt Adjustable, G2411P

KOORUI 24 Inch IPS Gaming Monitor, FHD 1920×1080p, 165Hz 200Hz Monitors, 1ms with Adaptive Sync, DCI-P3 90% Color Gamut, HDR400, 2 x HDMI 2.0, DisplayPort 1.4, Tilt Adjustable, G2411P

(4,083)
$139.99$126.47
FREE delivery Tue, Aug 12
400+ bought in past month
Loading...
KOORUI 34-inch Ultrawide Curved WQHD 3440×1440 Gaming Monitor, 165Hz 144Hz Curved 1000R- PIP/PBP, 1ms(MPRT) with DisplayHDR 400, DCI-P3 90% Color Gamut, AdaptiveSync, HDMI/DisplayPort, 34E6UC

KOORUI 34-inch Ultrawide Curved WQHD 3440×1440 Gaming Monitor, 165Hz 144Hz Curved 1000R- PIP/PBP, 1ms(MPRT) with DisplayHDR 400, DCI-P3 90% Color Gamut, AdaptiveSync, HDMI/DisplayPort, 34E6UC

(3,528)
$349.99
FREE delivery Sun, Aug 10
100+ bought in past month
Loading...
Gawfolk 32 Inch 4K UHD (3840 x 2160) High Resolution,60Hz Ultra-Thin Bezel Computer Monitor ,with HDMI/DP, Home Office Business PC Monitor, Black

Gawfolk 32 Inch 4K UHD (3840 x 2160) High Resolution,60Hz Ultra-Thin Bezel Computer Monitor ,with HDMI/DP, Home Office Business PC Monitor, Black

(18)
$212.49
FREE delivery Tue, Oct 7
100+ bought in past month
Loading...
Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Noise-Cancelling Mic and LED Display, Built-in Mic for Clear Calls, Waterproof Design for Sports

(8)
$39.99
FREE delivery Tue, Nov 4
Loading...
Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

Monster N-Lite 211 Wireless Earbuds, Bluetooth 6.0 Stereo Headphones with Powerful Bass, Built-in Noise-Cancelling Mic for Clear Calls, LED Display, 36H Playtime, IPX5 Waterproof Design for Sports

(40)
$39.99
FREE delivery Thu, Nov 13
Loading...
Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

Lenovo LOQ 15.6" FHD 144Hz Gaming Laptop, Intel Core i5-12450HX, NVIDIA GeForce RTX 2050, 16GB DDR5, 2TB Storage (1TB SSD+1TB Docking Station Set), Number Pad, 720p Camera, Wi-Fi 6, Win 11, Gray

(2)
$1,369.00
FREE delivery Feb 24 - Mar 5
Loading...
Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

(40)
$1,399.00
FREE delivery Feb 24 - Mar 5
Loading...
Lenovo Legion 5 15.1" WQXGA 165Hz Gaming Laptop, Intel i9 14900HX, GeForce RTX 5070 8GB GDDR7, 16GB DDR5, 2TB Storage(1TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, Windows 11, Black

Lenovo Legion 5 15.1" WQXGA 165Hz Gaming Laptop, Intel i9 14900HX, GeForce RTX 5070 8GB GDDR7, 16GB DDR5, 2TB Storage(1TB SSD+1TB Docking Station Set), 24-Zone RGB Backlit Keyboard, Windows 11, Black

(68)
$2,749.00
FREE delivery Feb 24 - Mar 5
Loading...
ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

ASUS ROG Strix G16 Gaming Laptop, GeForce RTX 5070 Ti 12GB GDDR7, AMD Ryzen 9 8940HX, 64GB DDR5, 2TB SSD, Backlit Keyboard, Wi-Fi 6E, 16" WUXGA 165Hz Display, Win 11, Gray, 1TB Docking Station Set

(10)
$4,269.00
FREE delivery Feb 24 - Mar 5
Loading...
soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

soundcore by Anker P20i True Wireless Earbuds, 10mm Drivers with Big Bass, Bluetooth 5.3, 30H Long Playtime, IPX5 Water-Resistant, 2 Mics for AI Clear Calls, 22 Preset EQs, Customization via App

(61,759)
$29.99
FREE delivery Sat, Jun 14 on your first order
4K+ bought in past month
Loading...
The Pandy - Emotional Healing on Demand, Realistic Panda Plush for Emotional Support, Mimics Natural Movements for Realistic Comfort, Pandy Ai Plush with Ultra-Soft Fur, The Comfort Hug You Have

The Pandy - Emotional Healing on Demand, Realistic Panda Plush for Emotional Support, Mimics Natural Movements for Realistic Comfort, Pandy Ai Plush with Ultra-Soft Fur, The Comfort Hug You Have

(0)
$19.88
$4.99 delivery Aug 27 - Sep 9