Gemma 3 QAT Insane Speed Boost vs FP16?! Google AI's KILLER 27b

Video Description

In this video, we compare Gemma 3 QAT 27b to the 27b FP16 on Chat and Vision and the results are *shocking*. You won't believe how much faster and more efficient QAT is with little loss. Gemma 3 QAT ALSO allows you to run the 27b on 1x 3090 vs 3x 3090's. Is QAT 27b the best general local AI assistant yet? Find out! Quad 3090 Ryzen AI Rig Build 2025 Video w/cheaper components vs EPYC Build https://youtu.be/So7tqRSZ0s8 Written Build Guide with all the Updated AI Rig Component Options and Benchmarks https://digitalspaceport.com/local-ai-home-server-build-at-high-end-3500-5000-price/ QUAD 3090 AI HOME SERVER BUILD - https://youtu.be/JN4EhaM7vyw GPU Rack Frame https://geni.us/GPU_Rack_Frame Supermicro H12ssl-i MOBO (better option vs mz32-ar0) https://geni.us/MBD_H12SSL-I-O Gigabyte MZ32-AR0 MOBO https://geni.us/mz32-ar0_motherboard AMD 7V13 (newer, faster vs 7702) https://geni.us/EPYC_7V13_CPU RTX 3090 24GB GPU (x4) https://geni.us/GPU3090 256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable AMD SP3 Air Cooler (easier vs water cooler) https://geni.us/EPYC_SP3_COOLER iCUE H170i water cooler https://geni.us/iCUE_H170i_Capellix (sTRX4 fits SP3 and retention kit comes with the CAPELLIX) CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU 4i SFF-8654 to 4i SFF-8654 (x4, not needed for H12SSL-i) https://geni.us/SFF8654_to_SFF8654 ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads HDD Rack Screws for Fans https://geni.us/HDD_RackScrews $1000 Z440 AI RIG PARTS - https://youtu.be/RMidGvCZc4g Workstation - HP Z440 https://geni.us/HP_Z440 GPU(s) - 24GB VRAM Options RTX 3090 24GB https://geni.us/GPU3090 RTX 3060 12GB (2x) https://geni.us/3060_GPU_12GB SSD - 1TB EVO 870 https://geni.us/evo-870-ssd-1TB Other HP Cheap Workstation Options HP Z640 https://geni.us/HP_Z640 HP Z840 https://geni.us/HP_Z840 Ways to Support: 🚀 Join as a member for members-only content and extra perks https://www.youtube.com/c/digitalspaceport/join ☕ Buy Me a Coffee https://www.buymeacoffee.com/digitalspaceport 🔳 Patreon https://www.patreon.com/digitalspaceport EXTERNAL ARTICLES: https://developers.googleblog.com/en/gemma-3-quantized-aware-trained-state-of-the-art-ai-to-consumer-gpus/ ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. *****