A · Important
[NVIDIA launches next-generation high-bandwidth memory technology NVIDIA NVHBM to provide higher memory performance and efficiency for XPU] August 31, as AI agents and trillion-parameter workloads become increasingly mainstream, the performance of AI infrastructure depends not only on computing power, but also on how computing, memory, storage, network and software are co-designed as a unified system. To help hyperscale enterprises and AI innovators build a new generation of semi-customized AI infrastructure, NVIDIA launched NVIDIA NVHBM technology, further expanding the NVIDIA NVLink Fusion technology solution. NVHBM is a next-generation high-bandwidth memory technology that delivers higher memory performance and efficiency to the XPU. The technology will be validated and available from leading memory partners, making this advanced memory capability available to NVLink Fusion customers. By integrating the memory controller into the 3D HBM stack rather than on the XPU, NVHBM can achieve up to 30% memory bandwidth improvement compared to standard HBM4E, reduce HBM power consumption by 15%, and free up up to 25% area for the XPU compute die.
Comments