| GPU Model |
NVIDIA L40S |
| Architecture |
NVIDIA Ada Lovelace |
| Motherboard |
Lenovo |
| GPUs/Machine |
8x |
| Compute Units |
18176 |
| CPU Model |
2x AMD EPYC™ 9354 |
| CPU Cores |
32C/64T |
| Clock Speed |
1110 MHz |
| VRAM Type |
GDDR6 |
| VRAM Size |
48G |
| Memory Bandwidth |
864 |
| RAM |
768GB |
| RAM type |
TruDDR5 |
| Form Factor |
PCIe |
| TDP (Thermal Design Power) |
300W |
| Processing Power |
568 |
| Interconnect |
PCIe NVL |
| NVLink/InfiniBand |
Infiniband can be installed on request |
| SXM |
No |
| Cooling Solution |
Air Cooling |
| API Support |
DirectX, OpenGL, OpenCL, Vulkan, CUDA |
| Deep Learning Framework Support |
Supported |
| CUDA and OpenCL Support |
Supported |
| Performance Metrics |
TBC |
| Compatibility |
Compatible with all modern OSs |
| Local storage |
6x 7TB NVMe in MDRAID 10 |
| Type of storage |
NVMe |