The first footnote makes me want to give myself a lobotomy with a no. 2 pencil:
I wish to note here that Richard took this “as evidence that John would fail an intellectual turing test for people who have different views than he does about how valuable incremental empiricism is”. Of course I couldn’t just ignore an outright challenge to my honor like that, so I wrote a brief reply which Richard himself called “a pretty good ITT”.
If this guy doesn't masturbate his successful polemicizing every 1.5 paragraphs, he'll go into septic shock.
More like "People want things and hurt if they don't get them. Also, look at me saying things like utility function! Function is math! Math is smart. I am smart! Isn't that so cool?"
Does anyone have any updates on wtf is even going on there? Is it actually the libertarian utopia that I was promised? Or is it just a place for people with nice comfy remote jobs to exploit cheap Honduran labor to live large.
Absent from this analysis: reduction in QALYs resulting from perfectly good men being denied a child bride by some evil meddling NGO. Will someone please think of the poor men?
I'm actually somewhat surprised that the rationalists didn't bring this up.
Why does someone who writes great sci-fi suddenly have social capital to weigh in on industry and politics, two things firmly outside of his wheelhouse?
How absolutely dare someone comment about the perceived impact of their work?
but at what point did our hatred of capitalists (note: I don't hate capitalists) decide to overshadow our, you know, lifelong lust for the stars?
pauses sentence to perform a quick act of fellatio
Every time I read a technologist's screed against Musk or Bezos or Zuckerberg (three people whose combined lifetime works do not even scratch a fraction of the economic value incinerated by the US military in 40 weeks) all I can see is sour grapes and ad hominem.
Maybe take off your Musk-sperm-tinted glasses then?
These people did not create nor perpetuate the attributes of the dystopia you claim to reside in (that was the CIA). (It's also not actually a dystopia, or anything resembling one; ask any of the two billion people lifted out of dirt poverty (largely due to technology!) in the last three decades.)
No no no, it wasn't a system of misaligned incentives and lack of accounting of negative externalities that has created the dystopic world we live in today, it was the CIA! Wait, it's not actually a dystopia!
The old planet will go to hell in its own way from its own inhabitants. I'd rather live in space where it's safer. (Also, how cool would it be to escape before Earth is finally fully conquered? This would mean that humans as a species successfully avoid a total hierarchy.)
This is hard for me to digest because I have a lot of respect for Karpathy. His famous article on the potential of LSTMs as language models absolutely blew my mind. The innovations that led to LLMs stand on his shoulders, so how can he have such a poor take here?
I had a long sneer typed out but my shitty Lemmy app deleted my draft. Fuck the orange site and it's sophists. The whole prison subthread is probably one of the most disgusting things I've read from that shit hole in recent memory.
What happened with SBF will happen with an AI given a similar target, in terms of having misalignments that start out tolerable but steadily grow worse as capabilities increase and you face situations outside of the distribution, and things start to spiral to places very far than anything you ever would have intended.
Ah yes, one day someone will accidentally install the "I'm sorry, I can't let you do that Hal" plugin. Oops, I let the nuke launch AI override all of our control mechanisms, silly me!
Random musings but I feel like posting: I almost got sucked into the urbit hole. I thought it was such a cool idea and implementation, and all the fun names and technical purity was so attractive to me at age 18 (this was before the crypto circus and urbit barely did anything except talk to a terminal).
It took me a while to realize that there is, actually, zero reason to give nonsensical names to literally every aspect of software, and also pretty dumb to try to shoehorn everything through a tiny functional core ("Nock") while slowly re-learning all the lessons of 50 years of compiler development. So why use it at all?
Using urbit over a normal Linux stack comes purely with downsides. Slow, buggy, obscurantist, and so on. This means whoever actually dedicates their precious time to developing this unconditionally buys into the ideology. I never thought an ideology could be so powerful that it could corrupt the minds of my people (software monkeys).
A reminder that Rationalists have absolutely No Fucking Clue what they're talking about when it comes to quantum mechanics, and this is evident from the very top.
In this stunning vindication of Dunning-Kruger, EY sets up a thought experiment of a photon being ejected at a half-silvered mirror. Then, he realizes that QM is formulated with complex numbers, so he decides to shoehorn them by imagining a "computer program" that computes the result of the experiment and using the complex numbers as the internal state (because he read somewhere that a wave function is a complex-valued function). From there, he goes on to realize that he needs to actually justify the use of complex numbers, so he drops the fact that multiplying the "internal state" by i represents the photon turning 90 degrees (what?! yes, multiplying by i rotates complex numbers by 90 degrees but this has literally nothing to do with the direction the photon travels, what the ACTUAL fuck am I reading?)
I seriously want to pull my hair out after reading this asinine nonsense. MIT OCW's QM course is extremely accessible to anyone with a decent high-school math education but these chucklefucks' need to prove to themselves that they're smart supercedes any process of actual learning.
edit because I can't stop sneering: "wave function collapse" is purely born of the Copenhagen interpretation which EY rails against as ridiculous (which, admittedly, isn't a totally unpopular opinion for real physicists to have). This is, of course, 100% lost on SBF.
It would be extremely convenient for Sam "16 million dollar penthouse" Bankman-Fried if this whole deal was just an "oopsie, silly me." I get the schadenfreude angle but this guy totally doesn't deserve freedom.
What I'm the most thrilled about, however, is how he has effectively dismantled the rational case for "effective altruism" by showing how mind-bogglingly stupid the idea "earn to give" is. It's so easy to shut them down now with 3 magic letters: SBF
Nah bro, when GPT-5 comes out all code it'll write will exactly match the specification, and it'll also sim the entire universe to guess your mental state and correct any mistakes you made in your specs.
You were asked to give a use-case for LLMs, and with this comes the implicit assumption that it's not something that can be easily done with a tool that costs about seven orders of magnitude less to produce and operate.
A bunch of junior devs writing repetitive code because it's easier or people refusing to learn proper tools because "AI can write my JSON" aren't exactly good reasons tor the rest of the industry to learn how LLMs work. Don't get me wrong, there are good reasons, but you've not listed any.
For how much these fucks talk about "overcoming bias", they seem ABSOLUTELY incapable of overcoming their bias for IQ as a good measure of anything outside of acute mental disability. They want a simple answer to the question that has plagued their small minds forever: "Am I smarter than that person over there?" They cling to their number like a life-preserver in the ocean of society.
More details on the rust thing? I can't find it by searching keywords you mentioned but I must know.