Microsoft Azure CTO: US data centers will soon hit size limits
Microsoft Azure CTO: US data centers will soon hit size limits
As data centers grow in size, connecting multiple sites for a single training run may soon be necessary.
Infinite growth meets finite world.
Ah yes, the "when brute force isn't working you ain't using enough of it" approach to AI.
Maybe the secret police storing exabytes of the entire global populations data, to enrich their cronies in tech and surveillance capitalism, should reallocate those resources to something that benefits instead of enslaves?
AI is the biggest problem here
Yeah, I'm sure the largest data harvester on the planet isn't consuming an enormous volume of energy or resources, and certainly isn't also using AI to exhaustively analyze those exabytes of data with its hundreds of billions in blank cheque funding.
I too love big brother!
Just erased (really) that surveillance data, it will spare lots of memory for good goals. But they will go for more toys.
CCleaner, do your stuff!
Perhaps if they deleted all of the unnecessary user data they've collected they'd be able to consolidate it down to something reasonable
Given their AI ambitions, a solution could be building data centers in multiple locations to avoid overloading any one region’s power grid. It would be technically challenging, but it may be necessary, Russinovich told Semafor.
“I think it’s inevitable, especially when you get to the kind of scale that these things are getting to,” he said. “In some cases, that might be the only feasible way to train them is to go across data centers, or even across regions,” he said.
Pretty interesting!