Skip to content

NVIDIA® H100 PCIe NVL

Location

Pricing

160 cards available

Duration Cost Upfront payment
On-demand (hourly) $3.68/GPU-hr 0%
Month-to-month $3.51/GPU-hr 20%
3 months $3.36/GPU-hr 20%
6 months $3.13/GPU-hr 20%
1 year $2.86/GPU-hr 15%
2 years $2.73/GPU-hr 10%
3 years $2.61/GPU-hr 10%

Configuration

Component Details
GPU Model NVIDIA H100
Architecture NVIDIA Hopper
Motherboard Lenovo
GPUs/Machine 8
Compute Units 14592
CPU Model AMD EPYC 9354
CPU Cores 32C/64T
Clock Speed 1095
VRAM Type HBM2e
VRAM Size 80G
Memory Bandwidth 2.04TB/s
RAM 768G
RAM type TruDDR5
Form Factor PCIe
TDP (Thermal Design Power) 350W
Processing Power 456
Interconnect NVLink
NVLink/InfiniBand NVLink and Infiniband
SXM No
Cooling Solution Air Cooled
API Support All Supported
Deep Learning Framework Support All Supported
CUDA and OpenCL Support All Supported
Performance Metrics TBC
Compatibility All Supported
Local storage 6x7.68T NVMe in MDRAID 10
Type of storage NVMe