Inside a MEGA AI GPU Server with the NVIDIA HGX H200

ServeTheHome December 9, 2024
Video Thumbnail
ServeTheHome Logo

ServeTheHome

@servethehomevideo

About

The official ServeTheHome.com YouTube channel. From time to time we will have videos that are part of our reviews posted here.

Video Description

We take apart an NVIDIA HGX H200 8 GPU server from Aivres. The Aivres KR6288 is the company's Intel Xeon-powered AI server for the NVIDIA Hopper generation, and we have installed over 3.6Tbps of networking for a massive AI server. STH Main Site Article: Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Touring the xAI Colossus: https://youtu.be/Jf8EPSBZU7Y - NVIDIA HGX H100: https://youtu.be/4Np1HnWiHb4 - NVIDIA HGX A100: https://youtu.be/E6HJi0iqYbw - NVIDIA V100: https://youtu.be/2FV5zHO1z1M - NVIDIA P100: https://youtu.be/ipQXdjjAPGg - NVIDIA L40S: https://youtu.be/yKOg1DjtB50 - NVIDIA Arm with A100: https://youtu.be/t4dPmgZqWdk ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 02:45 NVIDIA HGX H200 Server Aivres KR6288 Hardware Overview 15:00 NVIDIA H200 Performance 16:00 NVIDIA H200 Power Consumption 18:21 Key Lessons Learned

Upgrade Your AI Server Now

AI-recommended products based on this video

Loading...
VGA PNY Quadro RTX 4000 ADA 20GB Retail (VCNRTX4000ADA-PB)

VGA PNY Quadro RTX 4000 ADA 20GB Retail (VCNRTX4000ADA-PB)

(10)
$2,633.34
Loading...
High-Performance Laptop Heatsink Compatible with 17 9700, RTX 2060 6GB, Precision 5750, Quadro RTX 3000 6GB - 0YC6P3 YC6P3 460.0JD02.0012

High-Performance Laptop Heatsink Compatible with 17 9700, RTX 2060 6GB, Precision 5750, Quadro RTX 3000 6GB - 0YC6P3 YC6P3 460.0JD02.0012

(0)
$173.93
FREE delivery Mar 10 - 30
Loading...
VGA PNY Quadro RTX 4000 ADA 20GB Retail (VCNRTX4000ADA-PB)

VGA PNY Quadro RTX 4000 ADA 20GB Retail (VCNRTX4000ADA-PB)

(10)
$2,633.34
Loading...
PNY NVIDIA Quadro RTX 4000 8GB GDDR6 Graphics Card

PNY NVIDIA Quadro RTX 4000 8GB GDDR6 Graphics Card

(5)
$961.39$899.85
FREE delivery Feb 26 - Mar 4
Loading...
PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

PNY NVIDIA Quadro RTX 4000 - The World’S First Ray Tracing GPU

(203)
$670.57$399.99
FREE delivery Feb 23 - 27
Loading...
CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

(235)
$879.99
FREE delivery Sun, Aug 24
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

SAMSUNG EVO Select Micro SD-Memory-Card + Adapter, 128GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME128SA/AM) [Canada Version]

(12,472)
$19.99$18.59
FREE delivery Sun, Aug 10 on your first order
400+ bought in past month
Loading...
Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]

Samsung EVO Select Micro SD Memory Card + Adapter, 256GB microSDXC 160MB/s Full HD & 4K UHD, UHS-I, U3, A2, V30, for Android Smartphones, Tablets, Nintendo-Switch (MB-ME256SA/AM) [Canada Version]

(11,340)
$34.99
FREE delivery Sat, Jun 14 on your first order
200+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

Crucial 64GB DDR5 RAM, 5600MHz (or 5200MHz or 4800MHz) Desktop Memory Kit, UDIMM 288-Pin, Compatible with 13th Gen Intel Core and AMD Ryzen 7000 - CT2K32G56C46U5

(2,409)
$181.38
FREE delivery Mon, Aug 11