NVIDIA® H100 PCIe
Location
Pricing
160 cards available
| Duration | Cost |
|---|---|
| Month-to-month | $3.51/GPU-hr |
| 3 months | $3.45/GPU-hr |
| 6 months | $3.40/GPU-hr |
| 12 months | $3.34/GPU-hr |
| 24 months | $3.28/GPU-hr |
| 36 months | $3.22/GPU-hr |
Configuration
| Component | Details |
|---|---|
| GPU model | NVIDIA® H100 |
| Architecture | NVIDIA® Hopper |
| Motherboard | ASUS |
| GPUs per node | 8 |
| CUDA cores | 16,896/GPU |
| CPU model | 2x AMD® EPYC 9454 48-Core Processor |
| CPU cores | 96 physical, 192 virtual |
| Total VRAM | 80 GB |
| VRAM type | HBM2 |
| Memory bandwidth | 3.4 TB/s |
| RAM | 1536 GB |
| RAM type | DDR5-4800 |
| Local storage | 2x 3.84 TB NVMe |
| Type of storage | NVMe |
| Form factor | PCIe |
| TDP (Thermal design power) | 350W |
| Tensor Cores | 512 Tensor Cores, 128 RT Cores |
| Interconnect | NVLink + Infiniband |
| SXM support | No |
Additional Storage Options
400+ TB available in August, pricing on-demand