.svg)
NVIDIA H100 96Gb HBM2 OEM — Specifications
Part Number965-2G520-A510-300
FP32 performance60 TFLOPS
FP64 performance30 TFLOPS
FP4 AI Performance3341 TOPS
Multi-Instance GPUUp to 7
NVENC/NVDEC7 x NVDEC
GPU Form FactorPCIe
Memory Bandwidth3.9 TB/s
Power Consumption350 – 400W (configurable)
Confidential computingSupported
Confidential ComputingActive
Bus interfaceNVLink + PCIe Gen5
GPU Memory96 GB HBM2
