INSIDE a 1.44TB HBM3e NVIDIA HGX B200 AI Server from ASRock Rack

Video Description

We take you inside the ASRock Rack 8U8X-GNR2 SYN B200. This is an NVIDIA HGX B200 8-GPU server that supports eight Blackwell GPUs, over 1.4TB of HBM3E memory, and over 4Tbps of networking. Of course, it also has some fun ASRock Rack features as well. STH Main Site Article: https://www.servethehome.com/asrock-rack-8u8x-gnr2-syn-b200-review-nvidia-hgx-b200-8-gpu-server-intel-xeon/ Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - ASRock Rack 6U NVIDIA HGX H200: https://www.servethehome.com/asrock-rack-6u8x-egs2-h200-nvidia-hgx-h200-ai-server-intel-xeon-review/ - ASRock Rack 2015 era GPU server review: https://www.servethehome.com/asrock-rack-3u8g-c612-8-way-gpu-server-review/ - NVIDIA HGX H200: https://youtu.be/dmOCYFVLi2M - NVIDIA HGX H100: https://youtu.be/4Np1HnWiHb4 - NVIDIA HGX A100: https://youtu.be/E6HJi0iqYbw - NVIDIA V100: https://youtu.be/2FV5zHO1z1M - NVIDIA P100: https://youtu.be/ipQXdjjAPGg - NVIDIA L40S: https://youtu.be/yKOg1DjtB50 - NVIDIA Arm with A100: https://youtu.be/t4dPmgZqWdk ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction to the Massive NVIDIA Blackwell AI Server 02:02 AI Server Hardware Overview 06:31 Intel Xeon 6 CPUs 09:59 4Tbps of Networking with NVIDIA ConnectX-7 NICs 11:48 12x 3kW Power Supplies 12:25 NVIDIA HGX B200 with 8 NVIDIA Blackwell GPUs and NVIDIA NVLINK Switches 16:46 Key Lessons Learned and Quick Performance Check