AMD Instinct MI325X

The AMD Instinct MI325X is a mid-generation refresh of the MI300 series, released in late 2024. It maintains the proven CDNA 3 architecture while upgrading to faster and denser HBM3E memory, increasing capacity to 256GB with 6TB/s bandwidth. The MI325X offers 1.3x better inference performance compared to NVIDIA's H100, making it an excellent choice for organizations seeking improved performance without the power requirements of the MI350 series. With the same 8 XCD + 4 IOD configuration as MI300X, it delivers 2,614 TOPS INT8 performance.