NVIDIA DGX B200 AI Appliance
Ultimate performance and a complete software stack for the most demanding AI workloads
The Ultimate AI Training Appliance by NVIDIA
The sixth-generation DGX datacentre AI appliance is built around the Blackwell architecture and the flagship B200 accelerator, providing unprecedented training and inferencing performance in a single system.
The DGX B200 includes 400Gb/s Connect-X7 Smart NICs and Bluefield DPUs for connecting to external storage, supported by the NVIDIA Base Command management suite and the NVIDIA AI Enterprise software stack, backed by specialist technical advice from NVIDIA DGXperts.
Accelerated AI with NVIDIA B200 GPUs
The latest DGX B200 appliance features eight SXM6 B200 Tensor Core GPUs, featuring a total of 1.44TB of memory, delivering up to 15x the performance of the DGX H100. The B200 GPUs are connected by 5th gen NVLink technology, creating the fastest AI platform available today.
| B200 | ||
|---|---|---|
| ARCHITECTURE | Blackwell | |
| GPU | 8x B200 | |
| CUDA CORES | 8x 16,896 | |
| TENSOR CORES | 8x 528 | |
| MEMORY | 8x 180GB HMB3e | |
| ECC MEMORY | ✔ | |
| MEMORY CONTROLLER | 4096-bit | |
| NVLINK SPEED | 8x 1.8TB/sec | |
AI-Ready Software Stack
NVIDIA Base Command powers the DGX systems, enabling organisations to leverage the best of NVIDIA software innovation. Enterprises can unleash the full potential of their DGX infrastructure with a proven platform that includes enterprise-grade orchestration and cluster management, libraries that accelerate compute, storage and network infrastructure, and an operating system optimised for AI workloads. This is further enhanced by NVIDIA AI Enterprise.
NVIDIA AI Enterprise
NVIDIA AI Enterprise unlocks access to a wide range of frameworks that accelerate the development and deployment of AI projects. Leveraging pre-configured frameworks removes many of the manual tasks and complexity associated with software development, enabling you to deploy your AI models faster as each framework is tried, tested and optimised for NVIDIA GPUs. The less time spent developing, the greater the ROI on your AI hardware and data science investments.
Rather than trying to assemble thousands of co-dependent libraries and APIs from different authors when building your own AI applications, NVIDIA AI Enterprise removes this pain point by providing the full AI software stack including applications such as healthcare, computer vision, speech and generative AI.
Enterprise-grade support is provided, 9x5 with a 4-hour SLA with direct access to NVIDIA’s AI experts, minimising risk and downtime, while maximising system efficiency and productivity. A three-year NVIDIA AI Enterprise license is included with 3XS AI workstations with A800 GPUs as standard. You can also purchase one, three- and five-year licenses with other GPUs.
Workload Management
Run:ai software allows intelligent resource management and consumption so that users can easily access GPU fractions, multiple GPUs or clusters of servers for workloads of every size and stage of the AI lifecycle. This ensures that all available compute can be utilised and GPUs never have to sit idle. Run:ai’s scheduler is a simple plug-in for Kubernetes clusters and adds high-performance orchestration to your containerised AI workloads.
FIND OUT MORE
AI Optimised Storage
AI Optimised storage appliances ensure that your NVIDIA DGX systems are being utilised as much as possible and always working at maximum efficiency. Scan AI offers software-defined storage appliances powered by PEAK:AIO and further options from leading brands such as Dell-EMC, NetApp and DDN to ensure we have an AI optimised storage solution that is right for you.
FIND OUT MORE
Managed Hosting Solutions
AI projects scale rapidly and can consume huge amounts of GPU-accelerated resource alongside significant storage and networking overheads. To address these challenges, the Scan AI Ecosystem includes managed hosting options. We’ve partnered with a number of secure datacentre partners to deliver tailor-made hardware hosting environments delivering high performance and unlimited scalability, while providing security and peace of mind. Organisations maintain control over their own systems but without the day-to-day admin or complex racking, power and cooling concerns, associated with on-premise infrastructure.
FIND OUT MORE
NVIDIA BasePOD & SuperPOD
DGX BasePOD and SuperPOD are NVIDIA reference architectures based around a specific infrastructure kit list that Scan can configure and deploy into your organisation to deliver AI at scale.
PODs start as small as 20 DGX nodes, scaling all the way to 140 nodes, managed by a comprehensive software stack to form a complete cluster.
Start your DGX Journey
The NVIDIA DGX B200 AI is available with three- and five-year support contract, extendable at a later period. There are also comprehensive media retention packages available for more data-sensitive projects.
GPU: 8x NVIDIA B200 80GB – 1.44TB total
CPU: 2x Intel Xeon Platinum 8570 – 112 cores / 224 threads total
RAM: 4TB ECC Reg DDR5
System Drives: 2x 1.92TB NVMe SSDs
Storage Drives: 8x 3.84TB NVMe SSDs
Networking: 8x 400Gb/s NVIDIA ConnectX-7 InfiniBand/Ethernet and 2x 400Gb/s NVIDIA Bluefield DPUs InfiniBand/Ethernet
Power: 14.3kW
Form Factor: 10U
