Ollama Local AI Server ULTIMATE Setup Guide: Open WebUI + Proxmox

Video Description

UPDATED GUIDES These guides are meant to be followed in this order: ▶️ Ollama Openwebui Video https://youtu.be/Met9pEfxsF8 📝 Ollama Openwebui Article https://digitalspaceport.com/how-to-setup-an-ai-server-homelab-beginners-guides-ollama-and-openwebui-on-proxmox-lxc/ ▶️ Llamacpp Unsloth Video https://youtu.be/CBNbM-RZgIQ 📝 Llamacpp Unsloth Article https://digitalspaceport.com/how-to-setup-an-ai-server-homelab-beginners-guides-llama-cpp-on-proxmox-9-lxc/ ▶️ vLLM Video https://youtu.be/CBNbM-RZgIQ 📝 vLLM Article https://digitalspaceport.com/how-to-setup-vllm-local-ai-homelab-ai-server-beginners-guides/ Running a local Ai Server that is fully private and self-hosted just got EASY! I will show you how to setup a killer system that works on ANY rig, from CPU only to single GPU to even Quad GPU and the best part, NO DOCKER NEEDED! Quad 3090 Ryzen AI Rig Build 2025 Video w/cheaper components vs EPYC Build https://youtu.be/So7tqRSZ0s8 Written Build Guide with all the Updated AI Rig Component Options and Benchmarks https://digitalspaceport.com/local-ai-home-server-build-at-high-end-3500-5000-price/ QUAD 3090 AI HOME SERVER BUILD https://youtu.be/JN4EhaM7vyw PARTS GPU Rack Frame https://geni.us/GPU_Rack_Frame Supermicro H12ssl-i MOBO (better option vs mz32-ar0) https://geni.us/MBD_H12SSL-I-O Gigabyte MZ32-AR0 MOBO https://geni.us/mz32-ar0_motherboard AMD 7V13 (newer, faster vs 7702) https://geni.us/EPYC_7V13_CPU RTX 3090 24GB GPU (x4) https://geni.us/GPU3090 256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable AMD SP3 Air Cooler (easier vs water cooler) https://geni.us/EPYC_SP3_COOLER iCUE H170i water cooler https://geni.us/iCUE_H170i_Capellix (sTRX4 fits SP3 and retention kit comes with the CAPELLIX) CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU 4i SFF-8654 to 4i SFF-8654 (x4, not needed for H12SSL-i) https://geni.us/SFF8654_to_SFF8654 ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads HDD Rack Screws for Fans https://geni.us/HDD_RackScrews BUDGET 12GB AI SERVER https://youtu.be/iflTQFn0jx4 Dell Precision 3620 Tower https://geni.us/Precision_3620 3060 12GB GPU https://geni.us/3060_GPU_12GB GPU 6 to 8 pin Power Adapter https://geni.us/GPUPowerAdapt6pin-8pin SUPER BUDGET 4GB AI SERVER https://youtu.be/VV30CMHc-kY Dell Optiplex 7050 MT https://geni.us/OptiPlex7050MT Quadro K2200 GPU (x2) https://geni.us/K2200_GPU LOCAL AI SERVER BUILD WRITEUPS Super Low Budget Ai Server https://digitalspaceport.com/local-ai-home-server-at-super-low-150-budget-price/ Low Budget Ai Server https://digitalspaceport.com/local-ai-home-server-at-low-350-budget-price/ Mid Range Ai Server https://digitalspaceport.com/local-ai-home-server-build-at-mid-range-750-price/ High End AI Server https://digitalspaceport.com/local-ai-home-server-build-at-high-end-5000-price/ 👍 Subscribe youtube.com/c/digitalspaceport?sub_confirmation=1 🌐 Website https://digitalspaceport.com Ways to Support: 🚀 Join as a member for members-only content and extra perks https://www.youtube.com/c/digitalspaceport/join ☕ Buy Me a Coffee https://www.buymeacoffee.com/digitalspaceport 🔳 Patreon https://www.patreon.com/digitalspaceport Chapters 0:00 Ollama Openwebui Local AI Server guide 0:49 Quad GPU Ai Rig Specs 1:34 Bios Settings 2:37 Download and Burn Proxmox ISO 3:26 Install Proxmox 4:59 Proxmox system setup 6:38 Proxmox GPU Software requirements 9:22 Install Ollama and Openwebui LXC 12:19 Openwebui User Interface Overview 18:14 Proxmox LXC GPU Passthrough Setup 23:37 Enable Reboot GPU Persistance 26:40 LXC Resource Management 28:01 Conclusion ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. *****