AMD announces MI350P PCIe AI accelerator card with 144GB of HBM3E — roughly 40% faster in FP16 and FP8 theoretical compute compared to Nvidia's H200 NVL competitor

TL;DR AI
2 min readKey summary
AMD launched the Instinct MI350P, a 600W PCIe AI accelerator with 128 compute units and 144GB of HBM3E.
It is designed for air-cooled enterprise servers and can scale to eight cards per system.
AMD says the MI350P delivers higher theoretical FP16 and FP8 performance than Nvidia’s H200 NVL.
The card is aimed at inference and RAG workloads, giving AMD a new high-end PCIe option for data centers.

