At the Advancing AI 2024 conference in San Francisco, AMD officially unveiled its next-generation GPU accelerator card, the Instinct MI325X, designed to compete with the NVIDIA Blackwell.
As per the official data, the MI325X supports simultaneous operations across eight units to create a platform, featuring up to 2TB of HBM3E memory, 48TB/s bandwidth, and performance levels reaching FP16 10.4 PFlops (104 million times per second) and FP8 20.8 PFlops (208 million times per second).
When compared to NVIDIA's H200 HGX integrated platform, the MI325X platform offers 1.8 times the memory capacity, 1.3 times the memory bandwidth, and 1.3 times the computational power.
Regarding the performance of various large model inferences, the MI325X can outperform the NVIDIA H200 by 20-40% in both single-card and eight-card configurations. For training performance, while the single card takes a 10% lead over the H200, the eight-card platform remains comparable.
AMD anticipates that the MI325X will enter production in the fourth quarter of 2024, with customer deliveries beginning in the first quarter of 2025.
Importantly, AMD also revealed its latest AI chip roadmap during the event. The MI350 series, utilizing the company's CDNA 4 architecture, is set to launch next year, while the MI400 series will adopt the more advanced CDNA architecture.
Following NVIDIA's footsteps, AMD plans to update its AI chips annually.
According to AMD CEO Lisa Su, the data center, AI, and accelerator markets are projected to expand to $500 billion by 2028.
Some analysts suggest that AMD has already outpaced Intel, but the journey to rival NVIDIA is still ongoing.
Lisa Su previously commented in an interview that the AI chip market is expansive enough to support multiple companies, and AMD doesn't need to surpass NVIDIA to achieve success.
Contrasting AMD's steady progress, Intel's business revenue has been declining and is currently facing its worst financial period in 50 years. This downturn is attributed to various factors, primarily the lack of AI business opportunities and subpar execution of goals within its foundry and chip divisions.
Some media voices argue that contemporary market dynamics vividly illustrate how a corporation can falter when failing to adapt to trends, particularly highlighting Intel's absence from the thriving AI sector.
Meanwhile, NVIDIA's Jensen Huang is confidently capitalizing on the AI surge, with bright prospects for the company's future.
