Amazon announced a new DPU at re:Invent 2022, the AWS Nitro v5. Amazon does not call this the DPU, even as the primary catalyst for the segment, but we need some industry terminology. The cloud provider has a new faster chip built by its Annapurna Labs team and shows impressive gains.
If you want to learn more about AWS Nitro, and why it is being used for some background, see AWS Nitro the Big Cloud DPU Deployment Detailed.
AWS Nitro 5 Ups the Cloud DPU Game Again
AWS Nitro v5 is more than a small change. It has grown to twice the transistors, with faster PCIe and DRAM. DPUs are going to grow over time to offer more services and handle higher speeds.
Adding twice the transistor count, PCIe bandwidth, and 50% higher memory speed gives Nitro v5 60% higher performance with lower latency, and AWS says better performance per watt.
Here is a quick shot of the card with the chip DRAM, and an interesting edge connector configuration.
AWS is rolling this out with the AWS C7gn instance with Graviton and Nitro v5.
AWS also went into how it is able to do things like stop using TCP, instead using SRD and running that over Nitro and more.
As AWS builds its solution of integrated hardware and software into an increasingly proprietary stack, it is doing a lot of really interesting engineering. The Nitro project is now on its 5th public version and has lit a fire under the industry. Even with that, we have heard many vendors discuss DPUs, we have started to test publicly available DPUs, but we are not seeing them widely deployed yet outside of hyper-scale clouds. AWS is that far ahead in this and continues innovating.