NVIDIA® H100 PCIe NVL

Location

• Australia DC-1

Pricing

160 cards available

Duration	Cost	Upfront payment
On-demand (hourly)	$3.68/GPU-hr	0%
Month-to-month	$3.51/GPU-hr	20%
3 months	$3.36/GPU-hr	20%
6 months	$3.13/GPU-hr	20%
1 year	$2.86/GPU-hr	15%
2 years	$2.73/GPU-hr	10%
3 years	$2.61/GPU-hr	10%

Configuration

Component	Details
GPU Model	NVIDIA H100
Architecture	NVIDIA Hopper
Motherboard	Lenovo
GPUs/Machine	8
Compute Units	14592
CPU Model	AMD EPYC 9354
CPU Cores	32C/64T
Clock Speed	1095
VRAM Type	HBM2e
VRAM Size	80G
Memory Bandwidth	2.04TB/s
RAM	768G
RAM type	TruDDR5
Form Factor	PCIe
TDP (Thermal Design Power)	350W
Processing Power	456
Interconnect	NVLink
NVLink/InfiniBand	NVLink and Infiniband
SXM	No
Cooling Solution	Air Cooled
API Support	All Supported
Deep Learning Framework Support	All Supported
CUDA and OpenCL Support	All Supported
Performance Metrics	TBC
Compatibility	All Supported
Local storage	6x7.68T NVMe in MDRAID 10
Type of storage	NVMe