NVIDIA® H100 80GB SXM5

Location

2048 cards available

Duration	Cost	Upfront payment
6 months	$3.20/GPU-hr	40% of total
1 year	$2.60/GPU-hr	25% of total

File storage

Type	Cost per GB-month
Fast scratch storage	$0.075
Object storage	$0.035

Component	Details
GPU Model	NVIDIA® H100 80GB SXM5 with NVLink interconnect
Motherboard	Supermicro
GPUs per node	8
CPU Model	2x Intel® Xeon 8462Y+
CPU clock speed	2.8 GHz
RAM	2TB
RAM type	DDR5
Local storage	2x 960GB PCIe Gen4 NVMe 2x 7.68TB PCIe Gen4 NVMe
Storage specifications	Weka Converged (1.5 PB increments) Optional Ceph
Networking interfaces	8x ConnectX-7 NDR OSFP 1x ConnectX-6 100GbE QSFP56
Networking specifications	3.2 Tbps NDR aggregate InfiniBand fabric for GPU Direct 100 Gbps, in-band management