Supermicro SYS-822GS-NB3RT-01-G2 8U Gold Series HGX B300 NVL8 GPU SuperServer

Experience The HGX Platform with Eight NVIDIA B300 GPUs for Large-Scale AI

The Supermicro SYS-822GS-NB3RT-01-G2 is an 8U rackmount AI workstation built around NVIDIA HGX B300 8-GPU architecture. With eight NVIDIA B300 SXM GPUs delivering 288GB GPU memory, the platform is aimed at demanding AI workloads including large-scale inference serving, model development and other GPU-accelerated applications that require substantial compute and memory resources.

Dual Intel Xeon 6768P Processors

At the heart of the system are 2x Intel Xeon 6768P processors, each providing 64 cores at 2.4GHz. The dual-socket configuration delivers 128 CPU cores and provides considerable host-side compute for data preparation, orchestration, virtualisation and CPU-intensive AI workloads.

2TB of High-Speed DDR5 ECC

The workstation is configured with 2TB of DDR5-6400 ECC RDIMM memory, giving large AI models and datasets ample system memory for demanding workloads. The motherboard provides 32 DIMM slots, while the platform supports up to 8TB of ECC DDR5 RDIMM memory at 6400MT/s or 6000MT/s in a 1DPC configuration, allowing the system to be specified for even larger memory requirements.

NVIDIA NVLink and NVSwitch GPU Fabric

The eight B300 GPUs communicate through NVIDIA NVLink with NVSwitch, creating a high-bandwidth GPU-to-GPU fabric for multi-GPU applications. This is particularly important for AI workloads that distribute models or datasets across multiple accelerators, reducing the communication bottlenecks that can arise when GPUs rely solely on conventional host-level connectivity.

PCIe 5.0 CPU-to-GPU Connectivity

The HGX B300 architecture is paired with PCIe 5.0 x16 CPU-to-GPU interconnects, providing high-speed communication between the AMD EPYC processors and GPU subsystem. This supports efficient movement of data between the host CPUs and accelerators for workloads where CPU-side processing and GPU compute operate closely together.

800GbE ConnectX-8 Networking

For high-throughput networking, the workstation features 8-port 800GbE/XDR800 connectivity through ConnectX-8, with eight OSFP 800GbE ports on the front panel. This gives the system substantial network bandwidth for distributed AI infrastructure, high-speed data movement and connectivity to other compute and storage nodes. This front-accessible arrangement is suited to dense AI deployments where rapid network connectivity is a core part of the system architecture.

Six 6600W Titanium Power Supplies

Power delivery is built around six 6600W Titanium-level power supplies, arranged in a 3 + 3 redundant configuration. The redundancy architecture provides resilience across the power supply subsystem, while the Titanium-level units are rated at 96% efficiency, helping reduce power losses in a workstation with a substantial GPU and CPU power requirement.

Heavy-Duty Cooling for AI Workloads

Thermal management is handled by 12 heavy-duty system fans, with fan-speed control and monitoring built into the H14DSG-OM platform. PWM fan connectors, tachometer monitoring and chassis temperature monitoring provide the control and telemetry required to manage airflow across the dense compute hardware.

Comprehensive Server Management

Management support includes SuperCloud Composer (SCC), Supermicro Server Manager (SSM), Super Diagnostics Offline (SDO), Supermicro Thin-Agent Service (TAS), SuperServer Automation Assistant (SAA) and SFT-DCMS-SINGLE. These tools provide administrators with multiple options for system monitoring, diagnostics, automation and infrastructure management.

Flexible I/O for Instant Deployment

Despite its focus on high-speed compute and networking, the system retains practical connectivity for administration and local servicing. The front panel provides 1x USB 3.0 Type-A and 1x USB 2.0 Type-A, while display connectivity includes 1x VGA and 1x mini-DP. The platform also includes AMI 64MB UEFI BIOS for system firmware and configuration.

• 8U rackmount AI workstation with dual Intel Xeon 6768P processors, 128 combined CPU cores and 2TB DDR5-6400 ECC memory (16DPC Each).
• NVIDIA HGX B300 8-GPU platform with 8x B300 SXM GPUs and 288GB HBM3e memory.
• NVIDIA NVLink and NVSwitch GPU-to-GPU connectivity for multi-GPU workloads.
• On-board 960GB M.2 SSD Storage for boot/operating system.
• ConnectX-8 networking with 8x 800GbE OSFP ports and 2x 10GbE connectivity.
• PCIe 5.0 x16 CPU-to-GPU connectivity for high-speed host-to-accelerator communication.
• 3+3 power redundancy with 6x 6600W Titanium-level PSUs rated at 96% efficiency.
• 12 heavy-duty fans with PWM control, tachometer monitoring and thermal management.
• USB 3.0, USB 2.0, VGA and mini-DP I/O connectivity.
• 10 total 2.5" hot-swap bays with eight supporting NVMe and two SATA.
• Supermicro management and diagnostic support through SuperCloud Composer, Server Manager and Super Diagnostics Offline