Huawei is flexing its networking muscles with its newly unveiled CloudMatrix 384 supercomputer, and it looks like Nvidia could be in trouble.
With, I think, a massive grain of salt since this info is unverified and direct from the manufacturer...
Huawei’s official presentation claims their Cloudmatrix 385 supercomputer delivers 300 PFLOPS of computing power, 269 TB/s of network bandwidth, and 1,229 TB/s of total memory bandwidth. It also achieves 55 percent model fitting utilization (MFU) during training workloads and offers 2.8 Tbps of inter-card bandwidth, heavily emphasizing its strength in networking.