NVIDIA Not Interested in HBF Memory Despite 4TB Stacks Dwarfing HBM, Google Reportedly Locked as Sampling Begins This Year

TL;DR AI
2 min readKey summary
NVIDIA is reportedly not planning to use High-Bandwidth Flash (HBF), preferring existing HBM plus eSSDs for AI memory and storage needs.
The company is instead working with Kioxia on faster PCIe Gen7 SSDs, suggesting it sees flash-based alternatives as sufficient for now.
HBF, co-developed by SanDisk and SK Hynix, aims to deliver much larger capacities than HBM for AI inferencing and KV cache workloads.
Google is reportedly a likely early major customer, which could help validate HBF as samples are expected in the second half of this year.

