Nvidia just took two H100 cards and glued them together
GTC Nvidia’s strategy for capitalizing on generative AI hype: glue two H100 PCIe cards together, of course. At GTC this week, Nvidia unveiled a new version of its H100 GPU, dubbed the H100 NVL, which it says is ideal for inferencing large language models like ChatGPT or GPT4. And if it looks like two H100 PCIe cards stuck together, that’s because that’s exactly what it is. (Well, it’s got faster memory too, more on that later....