Skip to content

NVIDIA® H100 80GB SXM IB with NVLink

Location

Pricing

8 cards available

Duration Cost Upfront payment
On-demand (hourly) $3.68/GPU-hr $0
Month-to-month $3.62/GPU-hr $0
3 months $3.57/GPU-hr $0
6 months $3.45/GPU-hr $0
1 year $3.34/GPU-hr 1 month
2 years $3.22/GPU-hr 3 months
3 years $2.99/GPU-hr 6 months

Configuration

Component Details
GPU Model NVIDIA® HGX H100 4-GPU SXM 80GB HBM3
Architecture Hopper
Motherboard Dell® PowerEdge XE8640
GPUs per node 4
CPU Model Intel® Xeon® Gold 6448Y 2.1G, 32C/64
CPU Cores 128
VRAM Type HBM2e
VRAM Size 80GB (320GB total)
Form factor SXM
RAM 512GB
RAM type DDR5
Memory bandwidth 3.35 TB/s
Thermal Design Power (TDP) 700W
Interconnect NVLink: 900GB/s PCIe Gen5: 128GB/s
Cooling Air
Deep Learning Framework Support TensorFlow, PyTorch, and others
Local storage 10TB:
  • 1x8TB NVMe
  • 1x1TB NVMe
  • 1x960GB SSD