While AMD's new Radeon RX 6000 series graphics cards are likely to steal most of the headlines this week, AMD is also quietly disrupting the professional GPU market. Today, AMD officially announced the Instinct MI100, the “world's fastest HPC accelerator”.

AMD claims that the Instinct MI100 accelerator is the world's fastest HPC GPU and the first x86 server GPU to surpass the 10 teraflops performance barrier. The new GPU is built on the AMD CDNA architecture, enabling higher performance for HPC and AI. In all, the GPU is rated for up to 11.5 teraflops of peak FP64 performance and up to 46.1 teraflops  peak FP32 Matrix performance.

Here is the spec sheet for the AMD Instinct MI100:

Compute Units	Stream Processors	FP64 TFLOPS (Peak)	FP32 TFLOPS (Peak)	FP32 Matrix TFLOPS (Peak)	FP16/FP16 Matrix TFLOPS (Peak)	INT4 | INT8 TOPS (Peak)	bFloat16 TFLOPs (Peak)	HBM2 ECC Memory	Memory Bandwidth
120	7680	Up to 11.5	Up to 23.1	Up to 46.1	Up to 184.6	Up to 184.6	Up to 92.3 TFLOPS	32GB	Up to 1.23 TB/s

Using AMD's Matrix Core technology, the Instinct MI100 is said to deliver a near 7x boost in FP16 theoretical peak floating point performance for AI training workloads compared to prior generations.

As you would expect, this GPU does feature 32GB of HBM2 memory, clocked at 1.2GHz to deliver 1.23 TB/s of memory bandwidth. It also supports PCIe Gen 4 and AMD Infinity Fabric, allowing huge peer-to-peer performance and bandwidth gains.

KitGuru Says: AMD is gearing up to be a big part of the push towards exascale computing. Perhaps we'll start to see AMD's professional GPUs achieve similar success to AMD's EPYC CPUs. 

Become a Patron!