INSIDE a 1.44TB HBM3e NVIDIA HGX B200 AI Server from ASRock Rack

We take you inside the ASRock Rack 8U8X-GNR2 SYN B200. This is an NVIDIA HGX B200 8-GPU server that supports eight Blackwell GPUs, over 1.4TB of HBM3E memory, and over 4Tbps of networking. Of course, it also has some fun ASRock Rack features as well.

STH Main Site Article: https://www.servethehome.com/asrock-rack-8u8x-gnr2-syn-b200-review-nvidia-hgx-b200-8-gpu-server-intel-xeon/

Substack: https://axautikgroupllc.substack.com/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join
Professional Users Substack: https://axautikgroupllc.substack.com/

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: https://forums.servethehome.com
Follow on Twitter: https://twitter.com/ServeTheHome
Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/
Follow on Facebook: https://www.facebook.com/ServeTheHome/
Follow on Instagram: https://www.instagram.com/servethehome/

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- ASRock Rack 6U NVIDIA HGX H200: https://www.servethehome.com/asrock-rack-6u8x-egs2-h200-nvidia-hgx-h200-ai-server-intel-xeon-review/
- ASRock Rack 2015 era GPU server review: https://www.servethehome.com/asrock-rack-3u8g-c612-8-way-gpu-server-review/
- NVIDIA HGX H200: https://youtu.be/dmOCYFVLi2M
- NVIDIA HGX H100: https://youtu.be/4Np1HnWiHb4
- NVIDIA HGX A100: https://youtu.be/E6HJi0iqYbw
- NVIDIA V100: https://youtu.be/2FV5zHO1z1M
- NVIDIA P100: https://youtu.be/ipQXdjjAPGg
- NVIDIA L40S: https://youtu.be/yKOg1DjtB50
- NVIDIA Arm with A100: https://youtu.be/t4dPmgZqWdk
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction to the Massive NVIDIA Blackwell AI Server
02:02 AI Server Hardware Overview
06:31 Intel Xeon 6 CPUs
09:59 4Tbps of Networking with NVIDIA ConnectX-7 NICs
11:48 12x 3kW Power Supplies
12:25 NVIDIA HGX B200 with 8 NVIDIA Blackwell GPUs and NVIDIA NVLINK Switches
16:46 Key Lessons Learned and Quick Performance Check