Today, AMD is making some noise in the professional graphics market with the introduction of the Instinct MI200 series accelerators. AMD claims the new Instinct MI250 and the MI250X boast up to 4.9x better performance than the competition in double precision (FP64) HPC applications and enable 380 TFLOPs of peak theoretical half-precision (FP16) performance for AI workloads.
The Instinct MI200 series GPUs are built on AMD's new CDNA 2 architecture and double up as AMD's very first multi-die GPUs, supporting up to 128GB of HBM2e memory. With these GPUs, combined with 3rd Gen EPYC processors, AMD will achieve exascale computing in collaboration with the US Department of Energy's Oak Ridge National Laboratory, using the Frontier supercomputer expected to deliver more than 1.5 exaflops of peak computing.
In the table below, you can see the specs for both the AMD Instinct MI250 and the MI250X:
Model | Compute Units | Stream Processors | FP64|FP32 Vector (Peak) | FP64|FP32 Matrix (Peak) | FP16|bf16 (Peak) | INT4|INT8 (Peak) | HBM2e ECC Memory | Memory Bandwidth | Form Factor |
AMD Instinct MI250X | 220 | 14,080 | Up to 47.9 TF | Up to 95.7 TF | Up to 383 TF | Up to 383 TOPS | 128GB | 3.2 TB/s | OCP Accelerator Module |
AMD Instinct MI250 | 208 | 13,312 | Up to 45.3 TF | Up to 90.5 TF | Up to 362.1 TF | Up to 362.1 TOPS | 128GB | 3.2 TB/s | OCP Accelerator Module |
Some of the key features of the AMD Instinct MI200 accelerators include the CDNA 2 architecture with 2nd Gen Matrix Cores for accelerating FP64 and FP32 matrix operations, as well as the industry's first multi-die GPU design with AMD's new 2.5D Elevated Fanout Bridge technology, capable of delivering 1.8x more cores and 2.7x more memory bandwidth versus previous AMD GPUs.
As you would expect, AMD Infinity Fabric also makes a return here, with up to 8 Infinity Fabric links connecting the MI200 with an optimised 3rd Gen EPYC processor and other GPUs in the node to maximise overall performance and system throughput.
KitGuru Says: AMD has announced this just before Nvidia's next GTC conference, so it will be interesting to see how team green responds. For now, AMD looks to have some very impressive HPC accelerators on its hands here.