Nvidia’s H100: Funny L2, and Tons of Bandwidth

GPUs started out as devices meant purely for graphics rendering, but their highly parallel nature made them attractive for certain compute tasks too. As the GPU compute scene grew over the past cou…