AMD’s New Epyc Server Brand to Take on Deep Learning
by Joel Hruska
At its Financial Analyst Day, AMD made a number of announcements about its upcoming product launches and where it will focus in 2017. The company has historically used these events to forecast its performance over the next few years and is riding high after the successful launch of Ryzen 7 and Ryzen 5. Investors, however, have been jittery about the manufacturer’s stock performance so far this year and AMD was also looking to calm the waters as it rolls out new hardware.
We’ve known the codename for AMD’s Ryzen server CPUs, Naples, but the company unveiled the actual brand name today. Henceforth, AMD’s server CPUs will be sold under the Epyc brand. It’s pronounced like the ordinary word, and as brand names go…maybe it’ll grow on people? That’s pretty much the best we’ve got right now. Opteron was a stronger product name in our personal opinion, but ultimately, customers aren’t going to care what it’s called, they’ll care how it performs.
One point AMD made from the beginning of the event is that it focused on data centers when it brought Zen to market. We haven’t seen much in the way of server benchmarks on the core yet, but Ryzen 5 and 7 have been at their strongest when competing against Intel in workstation workloads like video editing and 3D rendering. Server workloads tend to be their own unique animal, but AMD enjoyed tremendous success with Opteron when it aimed Athlon 64 at the data center first, consumer workloads second. It’s not surprising to see company doubling down on this strategy again.
Diving into data centers
AMD’s argument for its own reentry into the data center acknowledges that the company’s market share is effectively 0 percent today. The company’s position is that while it’s been driven out of the market in recent years, it has previously established its chops as a provider of server solutions from single-socket blade servers to multi-socket systems.
The company’s Epyc processors will offer up to 32 cores with 128 lanes of PCI Express 3.0 connectivity and eight memory channels. This combination of massive memory bandwidth and core counts could give AMD a leg up on Intel in three key areas. First, AMD can offer an enormous amount of memory bandwidth on a single-socket system with all eight of its memory channels. Intel, in contrast, is limited to just four channels. Granted, Intel’s memory controller efficiency might prove to be higher than AMD’s, but eight channels is hard to argue with, particularly in a one-socket system, and the two-socket comparison is pretty strongly tilted for AMD.
Second, AMD is purposefully eschewing Intel’s habit of locking off certain capabilities to specific SKUs. Intel’s Xeon lines are subdivided by capability — some SKUs are for single-socket systems, some support two sockets, some range up to four sockets. AMD is simply declaring that all versions of all Epyc chips will have the same I/O, the same memory channels, and the same capabilities.
Third, AMD wants to position Epyc as an ideal match for machine learning and artificial intelligence workloads. To that end, it’s built a single-socket CPU with enough I/O connectivity to handle multiple Radeon Instinct cards. AMD noted that in other servers, customers are required to buy multi-socket systems simply to have enough connectivity to run a full complement of GPUs in them, as shown above. The 128 lanes of PCI Express connectivity that Epyc offers, in contrast, can drive six cards (16 lanes each) from one socket, with 32 lanes of PCI Express 3.0 left over for intra-chip communication.
One point of clarification here: Unlike Intel, which offers 40 PCI Express 3.0 lanes in a single socket and 80 lanes in a dual socket, AMD offers 128 lanes in both a 1S and 2S configuration. In the two-socket system, 64 lanes of PCIe 3.0 are dedicated to intra-chip communication, with each CPU offering 64 lanes of chipset I/O.
It’s going to take time for AMD to build any kind of market share in server, where it’s basically starting from scratch, but the company seemed bullish on the prospects for its CPU architecture and where Zen will take it in the data center space. But the company appears determined to retake share in a market where its 1S and 2S platforms are going to compare quite well against what Intel is fielding. If Naples is as strong in server workloads as Ryzen has been in workstation and desktop work, Intel could have a serious fight on its hands. AMD’s new platform could also win fans from companies building deep learning and AI platforms that want to field the maximum number of cards per socket without paying a premium for multi-socket solutions.
Originally published at www.extremetech.com on May 17, 2017.