NVIDIA L4, 24GB 6251Mhz, GDDR6 300 GB/s, PCIe Gen4 x16 , Single Slot, 72W, Tensor Core GPU, Ada Lovelace, 2YR Warranty

NVIDIA L4 Tensor Core GPU is Powered by the NVIDIA Ada Lovelace architecture Designed to deliver outstanding gaming and creating, professional graphics, AI, and compute performance. It has a Single slot card featuring 24 GB of DDR6 memory and a 72W maximum power limit. NVIDIA L4 Tensor Core GPU supports x16 PCIe 4.0 connectivity. As the most efficient NVIDIA accelerator for mainstream use, servers equipped with L4 power up to 120X higher AI video performance and 2.7X more generative AI performance over CPU solutions, as well as over 4X more graphics performance than the previous GPU generation.

FP32: 30.3 teraFLOPs
TF32 Tensor Core: 120 teraFLOPS
FP16 Tensor Core: 242 teraFLOPS
BFLOAT16 Tensor Core: 242 teraFLOPS
FP8 Tensor Core: 485 teraFLOPs
INT8 Tensor Core: 485 TOPs
GPU memory: 24GB
GPU memory bandwidth: 300GB/s
NVENC | NVDEC | JPEG decoders: 2 | 4 | 4
Max thermal design power (TDP): 72W
Form factor: 1-slot low-profile, PCIe
Interconnect: PCIe Gen4 x16 64GB/s