LLMs on RTX 4090 Laptop vs Desktop ๐Ÿคฏ not even close!

Alex Ziskind โ€ข February 11, 2025
Video Thumbnail
Alex Ziskind Logo

Alex Ziskind

@azisk

About

Cracking code and curiosities, I turn caffeine-fueled late nights into bytes of wisdom. Welcome aboard! Iโ€™m Alex, with 20+ years of mastering the art of coding and now, the craft of content creation. Subscribe to my channel and join me in unraveling software enigmas with in-depth tech reviews tailored for developers, with a dash of humor. Emojis suck ๐Ÿš€ https://www.youtube.com/@azisk?sub_confirmation=1

Video Description

It's not even close. Discount on SIHOO chair: https://hongkongsihoointelligenthomecolimited.pxf.io/azisk Discount code: YT6OFF Amazon: https://amzn.to/4jkRYPj Discount Code: K3CONWH8 ๐Ÿ›’ Gear Links ๐Ÿ›’ ๐Ÿ–ฅ๏ธ GMKTec mini OC with Oculink: https://amzn.to/42Td3KU ๐Ÿ› ๏ธ Oculink eGPU dock: https://amzn.to/3CPQfAX โšก Power supply: https://amzn.to/4aUrSi4 โŒจ๏ธ๐Ÿข Keyboard: https://www.keychron.com/products/keychron-q1-max-qmk-via-wireless-custom-mechanical-keyboard?ref=azisk ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW ๐Ÿ› ๏ธ๐Ÿš€ My NVMe SSD: https://amzn.to/3YLEySo ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind ๐ŸŽฅ Related Videos ๐ŸŽฅ FREE Local LLMs on Apple Silicon | FAST! https://youtu.be/bp2eev21Qfo ๐ŸŒ— RAM torture test on Mac - https://youtu.be/l3zIwPgan7M ๐Ÿ”‹ How long can they last? | ULTIMATE BATTERY TEST - https://youtu.be/u1XJAOf_W5w ๐Ÿ’ป 83 M3 MacBook Pros, and the one for YOU - https://youtu.be/ZPd2v3dteUc ๐Ÿ‘จโ€๐Ÿ’ป 15" MacBook Air | developer's dream - https://youtu.be/A1IOZUCTOkM ๐Ÿค– INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k ๐Ÿ› ๏ธ Developer Productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX Razer Blade 18 Core i9 14th gen with NVIDIA RTX 4090 Gigabyte RTX 4090 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” ๐Ÿ“ฑ LET'S CONNECT ON SOCIAL MEDIA ALEX ON TWITTER: https://twitter.com/digitalix โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โฑ๏ธ Chapters 00:00 Introduction 00:20 Desktop vs. Laptop RTX 4090 Differences 01:46 Why VRAM Matters for AI Workloads 02:59 Test Setup & Hardware Overview 04:32 Running AI Models: Llama & Performance Tests 08:56 Llama 3.2 vs. Qwen Coder Performance Comparison 16:00 Power Efficiency: Desktop vs. Laptop GPU 17:22 Sponsored Segment: Sihoo Doro C300 Chair 18:08 Real-World Performance in Coding & AI Tasks 25:00 Thermals & Noise Comparison 26:00 Cost Breakdown: Desktop vs. Laptop Setup 27:46 Final Verdict: Which One Should You Get? 28:06 Conclusion & Next Steps #๏ธโƒฃ #razer #rtx4090 #rtx5090 #sihoo #doroc300 #officechair #sihoochair

You May Also Like

Upgrade Your Gaming Setup

AI-recommended products based on this video

Loading...
Acer Nitro V 15.6 FHD 144Hz Gaming Laptop, Intel i7-13620H, 32GB DDR5, 1TB SSD, NVIDIA GeForce RTX 4060, Keyboard Backlight, Wi-Fi 6, HD Webcam, Windows 11 Home, Black, 256GB Docking Station Set

Acer Nitro V 15.6 FHD 144Hz Gaming Laptop, Intel i7-13620H, 32GB DDR5, 1TB SSD, NVIDIA GeForce RTX 4060, Keyboard Backlight, Wi-Fi 6, HD Webcam, Windows 11 Home, Black, 256GB Docking Station Set

(105)
$1,655.10
FREE delivery Wed, Jun 18
Loading...
MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

MSI Ultra-Slim Thin 15 VR-Ready High FPS Gaming Laptop, 15.6 FHD 144Hz, Intel Core i5-13420H, NVIDIA GeForce RTX 4060, 32GB RAM, 2TB SSD, Backlit KB, Wi-Fi 6, Bundle with PCO Notebook Fold Radiator

(0)
$4,697.44
FREE delivery Jun 23 - Jul 3Only 3 left in stock.
Loading...
Dell G16 Gaming Laptop 7630-16-inch QHD+ 240Hz 3ms Display, Intel Core i9-13900HX, 32GB DDR5 RAM, 1TB SSD, NVIDIA GeForce RTX 4060 8GB GDDR6, Windows 11 Home, Onsite Service - Metallic Nightshade

Dell G16 Gaming Laptop 7630-16-inch QHD+ 240Hz 3ms Display, Intel Core i9-13900HX, 32GB DDR5 RAM, 1TB SSD, NVIDIA GeForce RTX 4060 8GB GDDR6, Windows 11 Home, Onsite Service - Metallic Nightshade

(0)
$2,099.00
$11.58 delivery Aug 26 - 28
Loading...
Asus ROG Gladius III Wireless AimPoint Gaming Mouse, Connectivity (2.4GHz RF, Bluetooth, Wired), 36000 DPI Sensor, 6 programmable Buttons, ROG SpeedNova, Replaceable switches, Paracord Cable, White

Asus ROG Gladius III Wireless AimPoint Gaming Mouse, Connectivity (2.4GHz RF, Bluetooth, Wired), 36000 DPI Sensor, 6 programmable Buttons, ROG SpeedNova, Replaceable switches, Paracord Cable, White

(329)
$94.99$93.99
FREE delivery Sat, Jan 3
50+ bought in past month
Loading...
Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intelยฎ Coreโ„ข Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderboltโ„ข 4, USB Type-C, AI OC

Asus ROG STRIX Z890-A GAMING WIFI Z890 LGA 1851 ATX motherboard, Intelยฎ Coreโ„ข Ultra Series 2 Ready, Advanced AI PC-ready, 16+2+1+2 stages, DDR5, WiFi 7, 2.5G, 5x M.2, Thunderboltโ„ข 4, USB Type-C, AI OC

(54)
$299.99
FREE delivery Jan 11 - Feb 5
Loading...
Asus ROG Delta II Wireless Gaming Headset with Detachable Mic โ€“ Tri-Mode (BT, 2.4GHz, 3.5mm), 50mm Titanium-Plated Drivers, 110Hr Battery, Lightweight, for PC, PS5, PS4, Xbox, Switch, Mobile - Black

Asus ROG Delta II Wireless Gaming Headset with Detachable Mic โ€“ Tri-Mode (BT, 2.4GHz, 3.5mm), 50mm Titanium-Plated Drivers, 110Hr Battery, Lightweight, for PC, PS5, PS4, Xbox, Switch, Mobile - Black

(180)
$249.99$166.60
FREE delivery Sat, Jan 3
50+ bought in past month
Loading...
Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDM) - UHD (3840 x 2160), QD-OLED, 240Hz, 0.03ms, G-SYNC Compatible, Custom Heatsink, Graphene film, 99% DCI-P3, True 10-bit, 90W USB-C, 3 year warranty

Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDM) - UHD (3840 x 2160), QD-OLED, 240Hz, 0.03ms, G-SYNC Compatible, Custom Heatsink, Graphene film, 99% DCI-P3, True 10-bit, 90W USB-C, 3 year warranty

(909)
$1,663.35$1,355.90
FREE delivery Sat, Jan 3
Loading...
MSI Stealth A18 AI+ A3XWIG-013CA 18" UHD+ mini LED 120Hz Gaming Laptop, AMD Ryzen AI 9 HX 370, RTX 5080, 64GB DDR5, 2TB NVMe SSD, Windows 11 Home

MSI Stealth A18 AI+ A3XWIG-013CA 18" UHD+ mini LED 120Hz Gaming Laptop, AMD Ryzen AI 9 HX 370, RTX 5080, 64GB DDR5, 2TB NVMe SSD, Windows 11 Home

(1)
$4,499.00
FREE delivery Sat, Jan 3
Loading...
MSI Stealth 18 HX AI 18โ€ 240Hz QHD+ Gaming Laptop: Intel Ultra 9-275HX, NVIDIA Geforce RTX 5080, 32GB DDR5, 2TB NVMe SSD, Wi-Fi 7, Win 11 Home :Midnight Black A2XWIG-045US

MSI Stealth 18 HX AI 18โ€ 240Hz QHD+ Gaming Laptop: Intel Ultra 9-275HX, NVIDIA Geforce RTX 5080, 32GB DDR5, 2TB NVMe SSD, Wi-Fi 7, Win 11 Home :Midnight Black A2XWIG-045US

(12)
$3,999.00$3,587.85
FREE delivery Sat, Jan 3
Loading...
Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDM) - UHD (3840 x 2160), QD-OLED, 240Hz, 0.03ms, G-SYNC Compatible, Custom Heatsink, Graphene film, 99% DCI-P3, True 10-bit, 90W USB-C, 3 year warranty

Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDM) - UHD (3840 x 2160), QD-OLED, 240Hz, 0.03ms, G-SYNC Compatible, Custom Heatsink, Graphene film, 99% DCI-P3, True 10-bit, 90W USB-C, 3 year warranty

(909)
$1,663.35$1,355.90
FREE delivery Sat, Jan 3
Loading...
Asus ROG Swift 27โ€ 4K QD-OLED Gaming Monitor (PG27UCDM) - 240Hz, 0.03ms, Custom Heatsink, Neo Proximity Sensor, G-SYNC Compatible, 99% DCI-P3, True 10-bit color, DisplayPort 2.1a UHBR20, 3 yr warranty

Asus ROG Swift 27โ€ 4K QD-OLED Gaming Monitor (PG27UCDM) - 240Hz, 0.03ms, Custom Heatsink, Neo Proximity Sensor, G-SYNC Compatible, 99% DCI-P3, True 10-bit color, DisplayPort 2.1a UHBR20, 3 yr warranty

(64)
$1,199.99$1,115.99
FREE delivery Sat, Jan 3
50+ bought in past month
Loading...
Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDP) - WOLED, Dual Mode (4K 240Hz, FHD 480Hz), 0.03ms, G-SYNC Compatible, Custom Heatsink, AI Gaming, 99% DCI-P3,True 10-bit, USB-C 90W, 3yr Warranty

Asus ROG Swift 32โ€ 4K OLED Gaming Monitor (PG32UCDP) - WOLED, Dual Mode (4K 240Hz, FHD 480Hz), 0.03ms, G-SYNC Compatible, Custom Heatsink, AI Gaming, 99% DCI-P3,True 10-bit, USB-C 90W, 3yr Warranty

(192)
$1,399.99
FREE delivery Sat, Jan 3
50+ bought in past month
Loading...
Asus ROG Strix 32โ€ 4K HDR Gaming Monitor (XG32UCG) โ€“ 3840x2160, Dual Mode (4K 160Hz/FHD 320Hz), 0.3ms, Fast IPS, Extreme Low Motion Blur Sync, USB-C, G-SYNC Compatible, Tripod Socket, 3 yr Warranty

Asus ROG Strix 32โ€ 4K HDR Gaming Monitor (XG32UCG) โ€“ 3840x2160, Dual Mode (4K 160Hz/FHD 320Hz), 0.3ms, Fast IPS, Extreme Low Motion Blur Sync, USB-C, G-SYNC Compatible, Tripod Socket, 3 yr Warranty

(41)
$699.99$650.99
FREE delivery Sat, Jan 3
Loading...
Logitech G502 HERO High Performance Wired Gaming Mouse, HERO 25K Sensor, 25,600 DPI, RGB, Adjustable Weights, 11 Programmable Buttons, On-Board Memory, PC / Mac, Black
Best Seller

Logitech G502 HERO High Performance Wired Gaming Mouse, HERO 25K Sensor, 25,600 DPI, RGB, Adjustable Weights, 11 Programmable Buttons, On-Board Memory, PC / Mac, Black

(54,445)
$49.98$44.98
FREE delivery Tue, Oct 14
1K+ bought in past month
Loading...
CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

(17)
$379.99
FREE delivery Sun, Aug 24
Loading...
CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intelยฎ LGA 1700, AMDยฎ AM5 and Older - White

CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intelยฎ LGA 1700, AMDยฎ AM5 and Older - White

(56)
$149.99$125.33
FREE delivery Sun, Aug 24
Loading...
CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit โ€“ Hardline Water Cooling Loop โ€“ XC7 Elite CPU Water Block โ€“ XD5 Elite D5 Pump Res โ€“ XR5 360mm Radiator โ€“ 3X QX120 RGB Fans

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit โ€“ Hardline Water Cooling Loop โ€“ XC7 Elite CPU Water Block โ€“ XD5 Elite D5 Pump Res โ€“ XR5 360mm Radiator โ€“ 3X QX120 RGB Fans

(235)
$879.99
FREE delivery Sun, Aug 24
Loading...
NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

NEW SteelSeries Arctis Nova 3 Multi-Platform Gaming Headset - Signature Arctis Sound - ClearCast Gen 2 Mic - PC, PS5/PS4, Xbox Series X|S, Switch, Mobile

(9,500)
$99.98$67.37
PrimeFREE delivery Sat, Jun 14
100+ bought in past month
Loading...
New SteelSeries Arctis Nova Pro for Xbox Multi-System Gaming Headset - Premium Hi-Fi Drivers - Hi-Res Audio - 360ยฐ Spatial - GameDAC Gen 2 - Quad-DAC - ClearCast Gen 2 Mic - Xbox, PC, PS5/PS4, Switch

New SteelSeries Arctis Nova Pro for Xbox Multi-System Gaming Headset - Premium Hi-Fi Drivers - Hi-Res Audio - 360ยฐ Spatial - GameDAC Gen 2 - Quad-DAC - ClearCast Gen 2 Mic - Xbox, PC, PS5/PS4, Switch

(517)
$209.41$122.65
PrimeFREE delivery Sat, Jun 14
Loading...
Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

Western Digital 2TB WD Blue SA510 SATA Internal Solid State Drive SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 560 MB/s - WDS200T3B0A

(74,910)
$169.97
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black
Best Seller

Corsair Vengeance LPX 32GB (2 X 16GB) DDR4 3200 (PC4-25600) C16 1.35V Desktop Memory - Black

(16,675)
$112.99$101.69
FREE delivery Sun, Aug 10
500+ bought in past month
Loading...
EVGA 1000 GQ, 80+ GOLD 1000W, Semi Modular, EVGA ECO Mode, 5 Year Warranty, Power Supply 210-GQ-1000-V1,Black

EVGA 1000 GQ, 80+ GOLD 1000W, Semi Modular, EVGA ECO Mode, 5 Year Warranty, Power Supply 210-GQ-1000-V1,Black

(396)
$199.95
FREE delivery Tue, Oct 14
Loading...
Portable Air Conditioners, wobuzhi Evaporative Air Cooler with LCD Screen, Fan Speed&Spray, 7 RGB Lights,USB Powered,1-8H Timer, Personal Air Conditioners, Portable Air Conditioners for Home Office

Portable Air Conditioners, wobuzhi Evaporative Air Cooler with LCD Screen, Fan Speed&Spray, 7 RGB Lights,USB Powered,1-8H Timer, Personal Air Conditioners, Portable Air Conditioners for Home Office

(32)
$39.99
FREE delivery Sun, Aug 10
200+ bought in past month
Loading...
llano RGB Laptop Cooling Pad with Powerful Turbofan Gaming Cooler Radiator with Infinitely Variable Speed, Touch Control, LCD Screen, 3-Port USB Hub, Seal Foam for Notebook Computer 15-19in

llano RGB Laptop Cooling Pad with Powerful Turbofan Gaming Cooler Radiator with Infinitely Variable Speed, Touch Control, LCD Screen, 3-Port USB Hub, Seal Foam for Notebook Computer 15-19in

(1,404)
$129.99
Prime
200+ bought in past month
Loading...
Neck Fan with Cooling Plate,Portable Neck Fan Rechargeable Battery Powered,Bladeless Personal Air Conditioner Wearable Neck Cooler Fans,USB Electric Quiet Necklace AC Fans for Travel Outdoor Black

Neck Fan with Cooling Plate,Portable Neck Fan Rechargeable Battery Powered,Bladeless Personal Air Conditioner Wearable Neck Cooler Fans,USB Electric Quiet Necklace AC Fans for Travel Outdoor Black

(35)
$39.99
600+ bought in past month
Loading...
MSI MAG CORELIQUID A15 240 - AIO ARGB CPU Liquid Cooler - 240mm Radiator - AM5, LGA 1851 Ready - Dual 120mm ARGB PWM Fans, Black

MSI MAG CORELIQUID A15 240 - AIO ARGB CPU Liquid Cooler - 240mm Radiator - AM5, LGA 1851 Ready - Dual 120mm ARGB PWM Fans, Black

(21)
$89.99$85.49
FREE delivery Sat, Jan 3