AI Server #3 - Octa Nvidia GPU - Air cooled
This guide offers information on a mid range deep learning AI server. This AI server is a 4U rackmount device supporting 8 PCIe dual-slot NVIDIA RTX 6000 GPU accelerators, with two AMD EPYC 9354 host CPUs with 32 cores per processor.
Specification
| ARCHITECTURE | Ada Lovelace |
| GPU | 8x NVIDIA RTX 6000 ADA |
| GPU Memory | 384GB total, (48GB*8), DDR6 |
| Cuda cores | 18176*8 |
| Tensor cores | 568x4 |
| Motherboard | Dual Socket SP5 (LGA 6096) |
| CPU | Dual AMD EPYC™ 9354 Series Processor with AMD 3D (32 core, 64 thread) |
| RAM | 512GB DDR5 RAM |
| Networking | Dual 10G LAN for high-speed network connectivity |
| OS | Ubuntu Linux, Windows |
| Form factor | 4U rack |
| PSU | 2x2000 Watt |
More information
+36 1 371 0150