NVIDIA® H100 94GB NVL
Location
Pricing
40 cards available
| Duration | Cost | Upfront payment |
|---|---|---|
| Month-to-month | $2.65/GPU-hr | 1 week |
| 3 months | $2.53/GPU-hr | 3 weeks |
| 6 months | $2.42/GPU-hr | 6 weeks |
| 12 months | $2.30/GPU-hr | 8 weeks |
| 24 months | $2.19/GPU-hr | 12 weeks |
Configuration
| Component | Details |
|---|---|
| GPU Model | NVIDIA® H100 94GB NVL |
| GPUs per node | 8 |
| VRAM | 94 GB |
| VRAM type | HBM3 |
| Form factor | PCIe |
| CPU Model | 2x AMD® EPYC Genoa 9124 |
| CPU cores | 32 |
| RAM | 1.5TB |
| RAM type | DDR5 |
| Memory bandwidth | 3.9 TB/s |
| Thermal Design Power (TDP) | 400W |
| Interconnect | NVLink between pairs of H100 NVL GPUs |
| Local storage | 8TB NVMe |