AMD launches first multi-die GPU with new Instinct MI200 series accelerators

Today, AMD is making some noise in the professional graphics market with the introduction of the Instinct MI200 series accelerators. AMD claims the new Instinct MI250 and the MI250X boast up to 4.9x better performance than the competition in double precision (FP64) HPC applications and enable 380 TFLOPs of peak theoretical half-precision (FP16) performance for AI workloads. 

The Instinct MI200 series GPUs are built on AMD's new CDNA 2 architecture and double up as AMD's very first multi-die GPUs, supporting up to 128GB of HBM2e memory. With these GPUs, combined with 3rd Gen EPYC processors, AMD will achieve exascale computing in collaboration with the US Department of Energy's Oak Ridge National Laboratory, using the Frontier supercomputer expected to deliver more than 1.5 exaflops of peak computing.

In the table below, you can see the specs for both the AMD Instinct MI250 and the MI250X:

Model	Compute Units	Stream Processors	FP64|FP32 Vector (Peak)	FP64|FP32 Matrix (Peak)	FP16|bf16 (Peak)	INT4|INT8 (Peak)	HBM2e ECC Memory	Memory Bandwidth	Form Factor
AMD Instinct MI250X	220	14,080	Up to 47.9 TF	Up to 95.7 TF	Up to 383 TF	Up to 383 TOPS	128GB	3.2 TB/s	OCP Accelerator Module
AMD Instinct MI250	208	13,312	Up to 45.3 TF	Up to 90.5 TF	Up to 362.1 TF	Up to 362.1 TOPS	128GB	3.2 TB/s	OCP Accelerator Module

Some of the key features of the AMD Instinct MI200 accelerators include the CDNA 2 architecture with 2nd Gen Matrix Cores for accelerating FP64 and FP32 matrix operations, as well as the industry's first multi-die GPU design with AMD's new 2.5D Elevated Fanout Bridge technology, capable of delivering 1.8x more cores and 2.7x more memory bandwidth versus previous AMD GPUs.

As you would expect, AMD Infinity Fabric also makes a return here, with up to 8 Infinity Fabric links connecting the MI200 with an optimised 3rd Gen EPYC processor and other GPUs in the node to maximise overall performance and system throughput.

KitGuru Says: AMD has announced this just before Nvidia's next GTC conference, so it will be interesting to see how team green responds. For now, AMD looks to have some very impressive HPC accelerators on its hands here. 

Become a Patron!