NVIDIA® H100 80GB SXM IB with NVLink
Location
Pricing
8 cards available
| Duration | Cost | Upfront payment |
|---|---|---|
| On-demand (hourly) | $3.68/GPU-hr | $0 |
| Month-to-month | $3.62/GPU-hr | $0 |
| 3 months | $3.57/GPU-hr | $0 |
| 6 months | $3.45/GPU-hr | $0 |
| 1 year | $3.34/GPU-hr | 1 month |
| 2 years | $3.22/GPU-hr | 3 months |
| 3 years | $2.99/GPU-hr | 6 months |
Configuration
| Component | Details |
|---|---|
| GPU Model | NVIDIA® HGX H100 4-GPU SXM 80GB HBM3 |
| Architecture | Hopper |
| Motherboard | Dell® PowerEdge XE8640 |
| GPUs per node | 4 |
| CPU Model | Intel® Xeon® Gold 6448Y 2.1G, 32C/64 |
| CPU Cores | 128 |
| VRAM Type | HBM2e |
| VRAM Size | 80GB (320GB total) |
| Form factor | SXM |
| RAM | 512GB |
| RAM type | DDR5 |
| Memory bandwidth | 3.35 TB/s |
| Thermal Design Power (TDP) | 700W |
| Interconnect | NVLink: 900GB/s PCIe Gen5: 128GB/s |
| Cooling | Air |
| Deep Learning Framework Support | TensorFlow, PyTorch, and others |
| Local storage | 10TB:
|