People will fall over each other to explain exactly why these devices are no match for nvidia’s top cards like H100/B100, but that’s besides the point. For a lot of people out there top tier nvidia products are basically unobtainium anyway.
If they manage to actually get this into peoples hands, this is a VERY big deal.
If they manage to actually get this into peoples hands
To be clear, I think they're talking about mega-pricey server products, where the minimum size is usually 8 of them in a box. This isn't a home lab kind of thing.
Oh absolutely. The NV equivalent is priced at multiple millions of dollars. If you can get it.
Sucks you can’t get Chinese kit in USA though. At least I’ve never seen it available; not sure if it’s outright banned or US suppliers just don’t carry it
Huawei was uniquely, specifically, forced out of the US market around the time they were completing for 5G Tower standards.
Can you explain for those of us who don’t know those words and ackronyms?
I edited with a bit more context. They are mostly just product identifiers.
Unobtainium just nerd speak for “things that are nominally available but impossible to actually get your hands on”. It’s rooted in sci fi tropes that are in themselves very interesting but besides the point right now.
It's not theoretical. They've already released an 300B LLM dubbed Pangu Pro, trained on Huawei NPUs:
It's actually a really neat model: the experts are split into 8 'groups' and routed so that the same number are active in each group at any given time. In other words, it's specifically architected for 8X Huawei NPU servers, so that there's no excessive cross-communication or idle time between them.
So yeah, even if it's not a B200, proof's in the puddin, and huge models are being trained and run on these things.
People will fall over each other to explain exactly why these devices are no match for nvidia’s top cards like H100/B100, but that’s besides the point. For a lot of people out there top tier nvidia products are basically unobtainium anyway.
If they manage to actually get this into peoples hands, this is a VERY big deal.
To be clear, I think they're talking about mega-pricey server products, where the minimum size is usually 8 of them in a box. This isn't a home lab kind of thing.
Oh absolutely. The NV equivalent is priced at multiple millions of dollars. If you can get it.
Sucks you can’t get Chinese kit in USA though. At least I’ve never seen it available; not sure if it’s outright banned or US suppliers just don’t carry it
Huawei was uniquely, specifically, forced out of the US market around the time they were completing for 5G Tower standards.
Can you explain for those of us who don’t know those words and ackronyms?
I edited with a bit more context. They are mostly just product identifiers.
Unobtainium just nerd speak for “things that are nominally available but impossible to actually get your hands on”. It’s rooted in sci fi tropes that are in themselves very interesting but besides the point right now.