NVIDIA BlueField Data Processing Units

NVIDIA BlueField Data Processing Units

 

Revolutionising the Datacentre for AI

NVIDIA BlueField Data Processing Units (DPU) ignite unprecedented innovation for modern AI server architecture within datacentres. By offloading, accelerating, and isolating a broad range of advanced networking, storage, and security services, BlueField DPUs provide a secure and accelerated infrastructure for any artificial intelligence (AI) workload in any environment - from the cloud to the datacentre and out to the edge. BlueField DPUs combine powerful computing, full infrastructure-on-chip programmability, zero-trust security and high-throughput, low-latency networking to address the most demanding machine learning, deep learning and AI workloads.

Video
 

Security from the Perimeter to the Server

BlueField DPUs enable a zero-trust, security-everywhere architecture where security goes beyond the datacentre perimeter to the edge of every server, ensuring your critical AI datasets remain protected.

 

Data Storage for Demanding Workloads

BlueField DPUs provides high performance storage access with latencies for remote storage that rival direct attached storage. Features include NVMe over Fabrics (NVMe-oF), GPUDirect Storage, encryption, elastic storage, data decompression and deduplication.

 

High Performance, Efficient Networking

BlueField is a powerful datacentre services accelerator, delivering up to 400Gb/s of Ethernet and InfiniBand connectivity for modern GPU-accelerated workloads like deep learning and AI, while freeing host CPU cores to run applications instead of infrastructure tasks.

The Datacentre on a Chip Architecture

The NVIDIA datacentre-on-a-chip (DOCA) software framework enables developers to rapidly create applications and services for the BlueField-2 DPU. NVIDIA DOCA makes it easy to leverage DPU hardware accelerators, providing breakthrough datacentre performance, efficiency and security. With DOCA, program the datacentre infrastructure of tomorrow by creating high-performance, software-defined, cloud-native, DPU-accelerated services to address the increasing performance and security demands of modern datacentres.

Future Proof

DOCA provides multi-generational support to offer developers the confidence that applications developed today will consistently run with added performance benefits on all future generations of BlueField.

Offload, Accelerate, Isolate Infrastructure

Network, storage and security services are offloaded, accelerated and isolated on the DPU while data is securely delivered to workloads at wire speed.

Open Ecosystem

DOCA offers a software application framework to accelerate ecosystem development.

DOCA unlocks datacentre innovation by enabling developers to rapidly create applications and services on top of NVIDIA DPUs, leveraging industry-standard APIs. Together, DOCA and the BlueField DPU enable the development of applications that deliver breakthrough networking, security, and storage performance with a comprehensive, open development platform. BlueField isolates the infrastructure service domain from the workload domain to offer significant improvements in application and server performance, security, and efficiency, giving developers all the tools they need to realise the optimal, secure, accelerated datacentre.

The Benefits of Bluefield for AI

BlueField-3 DPUs

NVIDIA BlueField-3 is the first 400GbE / NDR DPU with line-rate processing of software-defined networking, storage, and cybersecurity. BlueField-3 combines powerful computing, high-speed networking, and extensive programmability to deliver software-defined, hardware-accelerated solutions for the most demanding workloads. From accelerated AI computing to hybrid cloud to cloud-native supercomputing and 5G wireless networks, BlueField-3 redefines the art of the possible.

Name Protocol Interfaces Maximum Speed Memory Host Bus RDMA / RoCE
NVIDIA Bluefield-3 Ethernet QSFP56 2x 200GbE / 1x 400GbE 16GB PCIe 5.0
Yes
NVIDIA Bluefield-3 Ethernet QSFP56 2x 200GbE / 1x 400GbE 16GB PCIe 5.0
Yes
NVIDIA Bluefield-3 InfiniBand QSFP56 2x 200Gb HDR / 1x 400Gb NDR 16GB PCIe 5.0
Yes
NVIDIA Bluefield-3 InfiniBand QSFP56 2x 200Gb HDR / 1x 400Gb NDR 16GB PCIe 5.0
Yes

BlueField-2 DPUs

NVIDIA BlueField-2 DPU provides innovative acceleration, security, and efficiency in every host. BlueField-2 datacentre infrastructure combines the power of the NVIDIA ConnectX-6 Dx with programmable Arm cores and hardware offloads for software-defined storage, networking, security, and management workloads. The accelerator also delivers superior performance, security, and reduced TCO for cloud computing platforms, enabling organisations to efficiently build and operate virtualised, containerised, and bare-metal infrastructures at massive scale.

Name Protocol Interfaces Maximum Speed Memory Host Bus RDMA / RoCE
NVIDIA Bluefield-2 Ethernet QSFP56 2x 100GbE / 1x 200GbE 16GB PCIe 4.0
Yes
NVIDIA Bluefield-2 Ethernet QSFP56 2x 100GbE / 1x 200GbE 16GB PCIe 4.0
Yes
NVIDIA Bluefield-2 InfiniBand QSFP56 2x 100Gb EDR / 1x 200Gb HDR 16GB PCIe 4.0
Yes
NVIDIA Bluefield-2 InfiniBand QSFP56 2x 100Gb EDR / 1x 200Gb HDR 16GB PCIe 4.0
Yes

Converged BlueField DPUs

NVIDIA converged accelerators combine the power of the NVIDIA Hopper or Ampere architecture with the enhanced security and networking capabilities of the NVIDIA BlueField DPU, all in a single high-performance package. This advanced architecture delivers unprecedented performance and strong security for AI-powered workloads in edge computing, telecommunications, and network security.

Name Protocol DPU GPU Maximum Speed Memory Host Bus RDMA / RoCE
NVIDIA H100CNX Ethernet / InfiniBand Bluefield-3 H100 2x 200Gb / 1x 400Gb 16GB PCIe 4.0
Yes
NVIDIA A100X Ethernet / InfiniBand Bluefield-2 A100 2x 100Gb / 1x 200Gb 16GB PCIe 4.0
Yes
NVIDIA A30X Ethernet / InfiniBand Bluefield-2 A30 2x 100Gb / 1x 200Gb 16GB PCIe 4.0
Yes