NVIDIA® RTX 4090
Location
Pricing
8 cards available (more coming soon)
| Duration | Cost | Upfront payment |
|---|---|---|
| On-demand | $0.61/GPU-hr | None |
| Month-to-month | $0.61/GPU-hr | None |
| 3 months | $0.55/GPU-hr | 1 month |
Configuration
| Component | Details |
|---|---|
| GPU model | NVIDIA® RTX 4090 |
| Architecture | NVIDIA® Ada Lovelace |
| Motherboard | Supermicro |
| GPUs per node | 2 |
| CUDA cores | 16,384 |
| CPU model | Intel Xeon® |
| CPU cores | 16 |
| CPU clock speed | 2.24 GHz |
| Total VRAM | 24 GB |
| VRAM type | GDDR6X |
| Memory bandwidth | 1.01 TB/s |
| RAM | 128 GB |
| RAM type | DDR3 |
| Local storage | 2 TB |
| Type of storage | SSD |
| Form factor | Dual-slot PCIe |
| TDP (Thermal design power) | 450W, maximum |
| Tensor Cores | 512 Tensor Cores, 128 RT Cores |
| Interconnect | None |
| SXM support | No |
| Graphics API support | DirectX, OpenGL |
Additional Storage Options
Scalable, redundant network storage over a 40 Gbps interconnect is available for $0.11/GB-month.