The ISS is aging, and for safety’s sake, NASA intends to incinerate the immense facility around 2031. To accomplish the job, the agency will pay SpaceX up to $843 million, according to a statement released on June 26.
See you guys in 2040
ChatGpt already is multiple smaller models. Most guesses peg chatgpt4 as a 8x220 Billion parameter mixture of experts, or 8 220 billion parameter models squished together
My one dark hope is AI will be enough of an impetus for somebody to update DMCA
> pay once, get access to everything everywhere
> thinks about Elsevier
OH GOD PLEASE NO
That doesn't seem to be the same article
Turns out that whole idea of women being the primary bearers of hundred of years of exploited reproductive labor might have had some weight to it, huh.
All that labor being redirected into "L'economie" means that, at base, you'll have less children.
This is interesting but I'll reserve judgement until I see comparable performance past 8 billion params.
All sub-4 billion parameter models all seem to have the same performance regardless of quantization nowadays, so 3 billion is a little hard to see potential in.
Those cost efficiencies are also at the expense of the Chinese government. The massive investment is all part of their green revolution policy package.
It's why Solar cells are also incredibly cheap to produce in China, and why they're also mostly sold in China.
I seriously doubt the viability of this, but I'm looking forward to being proven wrong.
The OSI just published a resultnof some of the discussions around their upcoming Open Source AI Definition. It seems like a good idea to read it and see some of the issues they're trying to work around...
https://opensource.org/blog/explaining-the-concept-of-data-information
I would recommend instead to use the AI Horde: https://stablehorde.net/ It's a collection of people hosting stable diffusion/text generation models
There's also openrouter which can connect to ChatGPT with a token-based system. (They check your prompts for hornyposting though)
They should probably do the same with cascade, seeing as that license seems to be more restrictive as well
Judging by my bank account I'm transitioning to non-profit status as well.
I think the type of situation where you start a business under your own labor, and then hire others to exploit their labor is possible in a well portioned socialist economy.
You wouldn't be able to hire "just a dishwasher." You'd enter into a mutually and equally benefitial partnership with somebody who you would share labor and extract the revenue from that labor equally.
The exact type of that relationship and the responsibility details are largely immaterial to whether it's exploitative at that point.
You kind of have to presuppose that in an equal partnership that one of the partners is not being exploited. Anything else is just kind of a partnership in name only.
Yes of course, there's nothing gestalt about model training, fixed inputs result in fixed outputs
I suppose the importance of the openness of the training data depends on your view of what a model is doing.
If you feel like a model is more like a media file that the model loaders are playing back, where the prompt is more of a type of control over how you access this model then yes I suppose from a trustworthiness aspect there's not much to the model's training corpus being open
I see models more in terms of how any other text encoder or serializer would work, if you were, say, manually encoding text. While there is a very low chance of any "malicious code" being executed, the importance is in the fact that you can check the expectations about how your inputs are being encoded against what the provider is telling you.
As an example attack vector, much like with something like a malicious replacement technique for anything, if I were to download a pre-trained model from what I thought was a reputable source, but was man-in-the middled and provided with a maliciously trained model, suddenly the system I was relying on that uses that model is compromised in terms of the expected text output. Obviously that exact problem could be fixed with some has checking but I hope you see that in some cases even that wouldn't be enough. (Such as malicious "official" providence)
As these models become more prevalent, being able to guarantee integrity will become more and more of an issue.