For H200 and GH200
Nvidia cannot meet the demand for its AI accelerators and will not be able to in the near future. But in addition to the fact that it needs as much production capacity as possible from TSMC, it also needs a lot of memory for these same accelerators. Nvidia reportedly pre-purchased $1.5 billion worth of HBM3E memory from Micron and Hynix.
Nvidia needs this memory for the H200 and GH200 accelerators, which will hit the market in the near future. These are models of the current generation, not the future (Blackwell).
It is unknown exactly how much memory Nvidia purchased for the specified amount, but the indicated accelerators are equipped with 141 GB of memory each.
It is also unclear what opportunities Micron and Hynix have to release such memory for other clients. It cannot be ruled out that Nvidia bought all the memory for many months in advance.