PNY NVIDIA L40S Graphics Card
Unparalleled AI and Graphics Performance for the Data Centre
Powered by the NVIDIA Ada Lovelace Architecture
The NVIDIA L40S GPU, based on the Ada Lovelace architecture, is the most powerful universal GPU for the data centre, delivering breakthrough multi-workload acceleration for large language model (LLM) inference and training, graphics, and video applications. As the premier platform for multi-modal generative AI, the L40S GPU provides end-to-end acceleration for inference, training, graphics, and video workflows to power the next generation of AI-enabled audio, speech, 2D, video, and 3D applications.
Fourth-Generation Tensor Cores
Hardware support for structural sparsity and optimised TF32 format provides out-of-the-box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities with DLSS to upscale resolution with better performance in select applications.
Third-Generation RT Cores
Enhanced throughput and concurrent ray-tracing and shading capabilities improve ray-tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware-accelerated motion blur and stunning real-time animations.
Transformer Engine
Transformer Engine dramatically accelerates AI performance and improves memory utilisation for both training and inference. Harnessing the power of the Ada Lovelace fourth-generation Tensor Cores, Transformer Engine intelligently scans the layers of transformer architecture neural networks and automatically recasts between FP8 and FP16 precisions to deliver faster AI performance and accelerate training and inference.
Data Centre Ready
The L40S GPU is optimised for 24/7 enterprise data centre operations and designed, built, tested, and supported by NVIDIA to ensure maximum performance, durability, and uptime. The L40S GPU meets the latest data centre standards, is Network Equipment-Building System (NEBS) Level 3 ready, and features secure boot with root of trust technology, providing an additional layer of security for data centres.
Product Specifications
| CUDA Cores | 18176 |
| Tensor Cores | 568 |
| RT Cores | 142 |
| GPU Memory | 48 GB GDDR6 ECC |
| Memory Bandwidth | 864 GB/s |
| Display Connectors | 4x DP 1.4a |
| Form Factor | Dual Slot |
| Thermal Solution | Passive |
| Maximum Power Consumption | 350 W |
