High-performance AMD EPYC™ CPUs and AMD Instinct™ accelerators target delivering unprecedented advance in energy efficiency for Artificial Intelligence training and Supercomputing applications
San Francisco, NFAPost: AMD announced a goal to deliver a 30x increase in energy efficiency for AMD EPYC CPUs and AMD Instinct accelerators in Artificial Intelligence (AI) training and High Performance Computing (HPC) applications running on accelerated compute nodes by 2025.
Accomplishing this ambitious goal will require AMD to increase the energy efficiency of a compute node at a rate that is more than 2.5x faster than the aggregate industry-wide improvement made during the last five years.
Accelerated compute nodes are the most powerful and advanced computing systems in the world used for scientific research and large-scale supercomputer simulations. They provide the computing capability used by scientists to achieve breakthroughs across many fields including material sciences, climate predictions, genomics, drug discovery and alternative energy.
Accelerated nodes are also integral for training AI neural networks that are currently used for activities including speech recognition, language translation and expert recommendation systems, with similar promising uses over the coming decade. The 30x goal would save billions of kilowatt hours of electricity in 2025, reducing the power required for these systems to complete a single calculation by 97 percent over five years.
Commenting on the company initiative, AMD Chief Technology Officer (CTO) and Executive Vice President Mark Papermaster said achieving gains in processor energy efficiency is a long-term design priority for AMD and the company is setting now a new goal for modern compute nodes using its high-performance CPUs and accelerators when applied to AI training and high-performance computing deployments.
“Focused on these very important segments and the value proposition for leading companies to enhance their environmental stewardship, AMD’s 30x goal outpaces industry energy efficiency performance in these areas by 150 percent compared to the previous five-year time period,” said AMD Chief Technology Officer (CTO) and Executive Vice President Mark Papermaster.
Intersect360 Research CEO Addison Snell said with computing becoming ubiquitous from edge to core to cloud, AMD has taken a bold position on the energy efficiency of its processors, this time for the accelerated compute for AI and High-Performance Computing applications.
“Future gains are more difficult now as the historical advantages that come with Moore’s Law have greatly diminished. A 30-times improvement in energy efficiency in five years will be an impressive technical achievement that will demonstrate the strength of AMD technology and their emphasis on environmental sustainability,” said Addison Snell.
Increased energy efficiency for accelerated computing applications is part of the company’s new goals in Environmental, Social, Governance (ESG) spanning its operations, supply chain and products. For more than twenty-five years, AMD has been transparently reporting on its environmental stewardship and performance. For its recent achievements in product energy efficiency, AMD was named to Fortune’s Change the World list in 2021 that recognizes outstanding efforts by companies to tackle society’s unmet needs.
Methodology
In addition to compute node performance/Watt measurements1, to make the goal particularly relevant to worldwide energy use, AMD uses segment-specific datacenter power utilisation effectiveness (PUE) with equipment utilization taken into account.
The energy consumption baseline uses the same industry energy per operation improvement rates as from 2015-2020, extrapolated to 2025. The measure of energy per operation improvement in each segment from 2020-2025 is weighted by the projected worldwide volumes multiplied by the Typical Energy Consumption (TEC) of each computing segment to arrive at a meaningful metric of actual energy usage improvement worldwide.
Koomey Analytics President Jonathan Koomey said the energy efficiency goal set by AMD for accelerated compute nodes used for AI training and High-Performance Computing fully reflects modern workloads, representative operating behaviors and accurate benchmarking methodology.
About AMD
For more than 50 years AMD has driven innovation in high-performance computing, graphics and visualization technologies ― the building blocks for gaming, immersive platforms and the datacenter.
Hundreds of millions of consumers, leading Fortune 500 businesses and cutting-edge scientific research facilities around the world rely on AMD technology daily to improve how they live, work and play. AMD employees around the world are focused on building great products that push the boundaries of what is possible.
AMD, the AMD Arrow logo, EPYC, Instinct and combinations thereof, are trademarks of Advanced Micro Devices, Inc. Other names are for informational purposes only and may be trademarks of their respective owners.