AI Home Server 24GB VRAM $750 Budget Build and LLM Benchmarking

Digital Spaceport April 10, 2025
Video Thumbnail
Digital Spaceport Logo

Digital Spaceport

@digitalspaceport

About

Homelab, Local AI Home Servers, and a Home Datacenter in my garage. Builds, setup guides, running and testing AI locally, benchmarking, server racks, storage servers, home networking, and much more nerd fun on this channel! 🤓 Check out our website for writeups accompanying many of our videos: 🌐 https://digitalspaceport.com 🚀 Join as a member of Digital Spaceport for extras like behind the scenes members-only content or just to support: https://www.youtube.com/c/digitalspaceport/join 🔔 Subscribe and ring the bell to get notified on our latest video releases, and follow along with all the videos and playlists for the topics you're interested in.

Video Description

$750 Budget Dual 3060 12GB Local Ai Server Writeup https://digitalspaceport.com/local-ai-home-server-build-at-mid-range-750-price/ on Proxmox with Ollama and OpenWebUI testing Google Gemma3 27b and 12b, Qwen QwQ 32b, Cogito 14b, Deepcoder 14b and Mistral3.1. Mistral appears broken currently however. Quad 3090 Ryzen AI Rig Build 2025 Video w/cheaper components vs EPYC Build https://youtu.be/So7tqRSZ0s8 Written Build Guide with all the Updated AI Rig Component Options and Benchmarks https://digitalspaceport.com/local-ai-home-server-build-at-high-end-3500-5000-price/ Also check out our video we did on testing the 5060 Ti 16GB: The Perfect Local AI GPU? NVIDIA's 5060 Ti 16GB Tested! https://youtu.be/sCc-y4LXfHs $750 AI SERVER BUILD HP Z440 https://geni.us/HP_Z440 3060 12GB (need 2 for 24GB) https://geni.us/3060_GPU_12GB 6 to 8 pin PCIe adapter cable https://geni.us/GPUPowerAdapt6pin-8pin $1000 Local Ai Server Benchmark 3090 vs Dual 3060s Performance is INSANE! https://youtu.be/RMidGvCZc4g $1000 Local Ai Home Server Writeup https://digitalspaceport.com/1000-local-ai-home-server-benchmark-z440-and-3090/ https://community-scripts.github.io/ProxmoxVE/ 👍 Subscribe youtube.com/c/digitalspaceport?sub_confirmation=1 🌐 Website https://digitalspaceport.com Ways to Support: 🚀 Join as a member for members-only content and extra perks https://www.youtube.com/c/digitalspaceport/join ☕ Buy Me a Coffee https://www.buymeacoffee.com/digitalspaceport 🔳 Patreon https://www.patreon.com/digitalspaceport Chapters 0:00 $750 Ai Server Build 1:21 Z440 System Overview 2:41 Z440 Front USB Boot Halt Bypass 3:03 Local Ai PC Setup 6:13 HP Z440 Bios Settings for Proxmox LXC 9:24 Proxmox Installation Steps 12:56 Ollama LLM Performance Numbers 24:50 Build Cost Breakdown 27:04 Conclusion ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. *****

Essential AI Server Upgrades

AI-recommended products based on this video

Loading...
Asus Prime B550M-A WiFi II AMD AM4 (3rd Gen Ryzen) Micro ATX Motherboard (PCIe 4.0, WiFi 6, ECC Memory, 1Gb LAN, HDMI 2.1/D-Sub, 4K@60HZ, Addressable Gen 2 RGB Header and Aura Sync)

Asus Prime B550M-A WiFi II AMD AM4 (3rd Gen Ryzen) Micro ATX Motherboard (PCIe 4.0, WiFi 6, ECC Memory, 1Gb LAN, HDMI 2.1/D-Sub, 4K@60HZ, Addressable Gen 2 RGB Header and Aura Sync)

(7,398)
$109.99$107.99
FREE delivery Sat, Jan 3
300+ bought in past month
Loading...
Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

Skytech Archangel Gaming PC Desktop – AMD Ryzen 5 3600 3.6 GHz, NVIDIA RTX 3060, 1TB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

(31)
$2,657.01$2,656.90
FREE delivery Feb 24 - Mar 3
Loading...
Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

Acer Nitro V 16 AI Gaming Laptop, 16" WUXGA 180Hz Display, AMD Ryzen 5 240, GeForce RTX 5050, 16GB DDR5, 512GB SSD, Backlit Keyboard, Copilot, Wi-Fi 6E, Win 11, Black, 1TB Docking Station Set

(40)
$1,399.00
FREE delivery Feb 24 - Mar 5
Loading...
ASUS TUF Gaming A15 Gaming Laptop, 15.6” 144Hz FHD Display, AMD Ryzen 5 7535HS Processor, GeForce RTX 2050, 8GB DDR5 RAM, 512GB PCIe SSD Gen 4, Wi-Fi 6, Windows 11, FA506NF-AS51-CA

ASUS TUF Gaming A15 Gaming Laptop, 15.6” 144Hz FHD Display, AMD Ryzen 5 7535HS Processor, GeForce RTX 2050, 8GB DDR5 RAM, 512GB PCIe SSD Gen 4, Wi-Fi 6, Windows 11, FA506NF-AS51-CA

(156)
$799.00$759.05
FREE delivery Mon, Feb 16
Loading...
BOSGAME E4 Mini PC, Ryzen 5 3550H Mini Computers, 16GB DDR4 1TB PCIe SSD, Dual RJ45 LAN, 4K Triple Display, USB-C & USB 3.2, Wi-Fi 5 & BT 5.0, Desktop Computers for Office, Home, Streaming

BOSGAME E4 Mini PC, Ryzen 5 3550H Mini Computers, 16GB DDR4 1TB PCIe SSD, Dual RJ45 LAN, 4K Triple Display, USB-C & USB 3.2, Wi-Fi 5 & BT 5.0, Desktop Computers for Office, Home, Streaming

(188)
$399.00
FREE delivery Sat, Jan 3
Loading...
Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black
Best Seller

Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black

(16,675)
$112.99$101.69
FREE delivery Sun, Aug 10
500+ bought in past month
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

(12,472)
$19.99$18.59
FREE delivery Sun, Aug 10 on your first order
400+ bought in past month
Loading...
Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]

Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]

(11,340)
$34.99
FREE delivery Sat, Jun 14 on your first order
200+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
EVA Storage Bag for GTX 1660 Super, RTX 2060 Super, 3060 Ti, and 3070 Graphics Cards, 40 x 36 x 5 cm, Compact Protective Case with Dust-Resistant Design, Black

EVA Storage Bag for GTX 1660 Super, RTX 2060 Super, 3060 Ti, and 3070 Graphics Cards, 40 x 36 x 5 cm, Compact Protective Case with Dust-Resistant Design, Black

(0)
$30.69
$0.88 delivery Mar 9 - 27
Loading...
Asus TUF Gaming 27” 1080P Monitor (VG279QL3A) - Full HD, 180Hz, 1ms, Fast IPS, Extreme Low Motion Blur, FreeSync Premium, G-SYNC Compatible, Speakers, DisplayPort, Height Adjustable, 3 Year Warranty

Asus TUF Gaming 27” 1080P Monitor (VG279QL3A) - Full HD, 180Hz, 1ms, Fast IPS, Extreme Low Motion Blur, FreeSync Premium, G-SYNC Compatible, Speakers, DisplayPort, Height Adjustable, 3 Year Warranty

(8,356)
$179.99$167.39
FREE delivery Sun, Jan 4Only 1 left in stock.
100+ bought in past month
Loading...
Asus TUF Gaming 27” 1080P HDR Monitor (VG279QM1A) - Full HD (1920 x 1080), 280Hz, 1ms, Fast IPS, Extreme Low Motion Blur Sync, Freesync Premium, G-SYNC Compatible, Speakers, Variable Overdrive

Asus TUF Gaming 27” 1080P HDR Monitor (VG279QM1A) - Full HD (1920 x 1080), 280Hz, 1ms, Fast IPS, Extreme Low Motion Blur Sync, Freesync Premium, G-SYNC Compatible, Speakers, Variable Overdrive

(3,783)
$209.99
FREE delivery Jan 13 - Feb 3
100+ bought in past month