NVIDIA® GH200 Grace Hopper Superchip

Location

• US DC-2

Pricing

15 cards available

Duration	Cost	Upfront payment
Month-to-month	$5.25/GPU-hr	One month
3 months	$5.15/GPU-hr	One month
6 months	$5.05/GPU-hr	Two months
12 months	$4.75/GPU-hr	Three months

Configuration

Component	Details
GPU model	NVIDIA® GH200 Grace Hopper Superchip
Architecture	NVIDIA® MGX™ Architecture
GPUs per node	1
CUDA cores	16,896
CPU model	NVIDIA® Grace™ (72 Arm® Neoverse V2 cores)
CPU cores	72
CPU clock speed	2.8 GHz
Total VRAM	96 GB
VRAM type	HBM3
Memory bandwidth	900 GB/s
RAM	480 GB, minimum
RAM type	LPDDRX
Local storage	1.8 TB
Type of storage	NVMe
Form factor	PCIe Gen 5
TDP (Thermal design power)	1000W
Tensor Cores	Gen 4, 528
Interconnect	InfiniBand (extra cost)
SXM support	SXM5
Operating system	Ubuntu 22.04 preferred