1 H100SXM H200SXM FP64 34teraFLOPS 34teraFLOPS FP64TensorCore 67teraFLOPS 67teraFLOPS FP32 67teraFLOPS 67teraFLOPS FP32TensorCore 989teraFLOPS 989teraFLOPS BFLOAT16TensorCore 1979teraFLOPS 1979teraFLOPS FP16TensorCore 1979teraFLOPS 1979teraFLOPS FP8TensorCore 3958teraFLOPS 3959teraFLOPS INT8TensorCore 3958TOPS 3960teraFLOPS GPUmemory 80GB 141GB GPUmemorybandwidth 3.35TB/s 4.8TB/s Decoders 7NVDEC7JPEG 8NVDEC7JPEG Maxthermaldesignpower(TDP) Upto700W(configurable) Upto701W(configurable) Multi-instanceGPUs Upto7MIGs@10GBeach Upto7MIGs@16.5GBeach Formfactor SXM SXM Interconnect NVLink:900GB/sPCIe Gen5:128GB/s NVLink:900GB/sPCIeGen5:128GB/s Serveroptions NVIDIAHGXH100 partnerandNVIDIA-CertifiedSystemswith4or8GPUsNVIDIADGXH100 with8GPUs NVIDIAHGMH200partnerandNVIDIA-CertifiedSystemswith4or8GPUs NVIDIAEnterprise Add-on Add-on