NVIDIA® H100 80GB SXM5
Location
Pricing
2048 cards available
| Duration |
Cost |
Upfront payment |
| Month-to-month |
$3.44/GPU-hr |
100% of total |
| 6 months |
$3.25/GPU-hr |
100% of total |
| 1 year |
$3.06/GPU-hr |
30% of total |
| 2 years |
$2.63/GPU-hr |
25% of total |
Disks, snapshots, and images
| Type |
Cost per GB-month |
| Network SSD |
$0.08 |
| Network HDD |
$0.03 |
| Non-replicated SSD |
$0.60 |
| High-performance SSD |
$0.13 |
| Snapshot |
$0.03 |
| Image |
$0.03 |
File storage
| Type |
Cost per GB-month |
| HDD file storage |
$0.03 |
| SSD file storage |
$0.09 |
Object storage
| Amount |
Cost per GB-month |
| First 1 GB |
Free |
| Over 1 GB |
$0.02 |
Configuration
| Component |
Details |
| GPU Model |
NVIDIA® H100 80GB SXM5 |
| Architecture |
NVIDIA® Hopper™ |
| Form factor |
SXM5 |
| Motherboard |
Custom |
| GPUs per node |
8 |
| VRAM |
80GB |
| VRAM type |
HBM3 |
| CUDA cores |
- 128 FP32 CUDA Cores per SM
- 16896 FP32 CUDA Cores per GPU
|
| CPU Model |
Intel® Xeon Platinum 8468 |
| CPU cores |
160 (20 per GPU) |
| CPU clock speed |
- Base: 1590 MHz
- Boost: 1980 MHz
|
| Interconnect |
NVLink and InfiniBand 3.23 |
| Memory bandwidth |
3.35 TB/s |
| RAM |
1280GB (160GB per GPU) |
| RAM type |
DDR5 |
| Thermal Design Power (TDP) |
Up to 700W (configurable) |
| Deep Learning Framework Support |
Everything that is compatible with CUDA and OpenCL |
| OS options |
- Ubuntu 22.04, 20.04, 18.04, 16.04
- Debian 12, 11, 10
- CentOS 7 and CentOS Stream
- Fedora 37
- openSUSE Leap 15.4
|
| Local storage |
None, but several NAS options available |
| Type of storage |
- High-performance SSD
- Non-replicated SSD
- Network SSD
- Network HDD
|