The number of GPUs depends on the server platform and configuration.
Most Octoserver systems are typically deployed with 4 to 8 GPUs per server, which offers the best balance between compute density, PCIe connectivity and system flexibility.
Current platforms include:
- 4U-E10G-ROMEX2 — commonly configured with up to 8 GPUs
- 4U-E10G-GENOAX2 — commonly configured with up to 8 GPUs
- 4U-E12G-ROME — supports up to 12 GPUs
In theory, the ROMEX2 and GENOAX2 platforms can be configured with more than 8 GPUs by using PCIe expansion hardware. In practice, however, this often isn’t ideal. Modern GPUs consume a large number of PCIe lanes, and once many GPUs are installed there may be very few lanes remaining for other components.
That means things like NVMe storage drives or high-speed network cards can become limited or impossible to add. For this reason, most real-world deployments keep GPU count per server at eight or fewer, leaving enough PCIe connectivity for storage, networking and other system components.
Larger environments usually scale by adding additional GPU servers rather than pushing extreme GPU counts into a single machine.
Some platforms also support higher GPU counts. For example, the 4U-E12G-ROME system can be configured with:
- 12 dual-slot GPUs running at PCIe 4.0 x8, or
- 6 larger 3.5-slot GPUs running at PCIe 4.0 x16
This chassis is designed for actively cooled GPUs, allowing higher card density while maintaining stable airflow. Power requirements scale accordingly depending on the GPU type used.