Amazon’s CEO disclosed for the first time that its self-developed AI chip Trainium2 business has achieved annual revenue of billions of dollars and has more than 1 million chips in production. This is mainly due to its "cost-effectiveness advantage" and large-scale adoption by key customers Anthropic. At the same time, Amazon released a new generation of chip Trainium 3 with a performance improvement of 4 times.
Amazon is using its self-developed AI chips to open up a new path to billions of dollars in revenue in a market dominated by Nvidia.
During the recent AWS re:Invent conference, Amazon revealed to the outside world for the first time the specific scale of its self-developed AI chip business. Amazon CEO Andy Jassy made it clear in his social media post that hisThe second-generation AI training chip Trainium2 business "already has huge traction and is a multi-billion-dollar business with annual revenue, with more than 1 million chips in production."
This statementFor the first time, the commercial success of Amazon’s self-developed chips was quantified, directly responded to the market’s concerns about its competitiveness in the field of AI infrastructure. Jassy emphasized that the core reason why customers choose Trainium is its "attractive price-performance advantage compared to other GPU options." This is Amazon's classic business model - providing self-developed technology at a lower price.
He revealed,More than 100,000 companies are currently using Trainium, and the chip supports most of the usage on Amazon's AI application development platform Bedrock.
Bedrock is a key AI service provided by Amazon that allows enterprise customers to choose among multiple AI models and build applications. The Trainium chip has become the main computing hardware of the platform, which means that Amazon has successfully completed vertical integration from hardware to services within its ecosystem.
Strong support from key customer Anthropic
Behind the billions of dollars in Trainium chip revenue, key customer adoption plays a decisive role. According to technology media CRN, AWS CEO Matt Garman revealed in an interview that AI startup Anthropic is one of the largest users of Trainium chips.
Garman said: "We are seeing great traction with Trainium2, especially from our partner Anthropic." He further pointed out that in a project called "Project Rainier," Amazon deployed more than 500,000 Trainium2 chips to help Anthropic build its next-generation Claude series of AI models. Project Rainier is Amazon’s most ambitious AI server cluster to date, designed to meet Anthropic’s rapidly growing computing power needs.
Amazon is a major investor in Anthropic, and as part of the investment agreement, Anthropic uses AWS as its primary model training cloud service provider. This strategic cooperation not only brings a stable source of revenue to Trainium chips, but also provides Amazon with a benchmark case to demonstrate the performance and scale of its chips.
A new generation of Trainium3 is released, challenging the NVIDIA ecosystem
While consolidating the existing market, Amazon is accelerating its catch-up through technological iterations. The company officially released the new generation AI chip Trainium3 at the re:Invent conference.According to Jassy, the performance of the new chip has achieved a significant jump. "Compared with Trainium2, Trainium3 will provide at least 4.4 times the computing performance, 4 times the energy efficiency, and nearly 4 times the memory bandwidth."
Despite significant progress, challenging Nvidia's market position remains a daunting task. Nvidia's moat lies not only in its GPU hardware, but also in its proprietary CUDA software platform, which has become the de facto standard for AI development. According to TechCrunch, rewriting AI applications for non-CUDA chips is a complex and costly task.
However, Amazon seems to be planning a response. The report said that its next-generation Trainium4 chip will be designed to work together with Nvidia's GPU in the same system. It remains to be seen whether the ultimate effect of this move will be to weaken Nvidia's share or further solidify its dominance on the AWS cloud.