Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)SW
Posts
37
Comments
1,898
Joined
2 yr. ago

  • This paragraph caught my interest. It used some terms I wasn’t familiar with, so I dove in.

    Ego gratification as a de facto supergoal (if I may be permitted to describe the flaw in CFAImorphic terms)

    TL note: “CFAI” is thisbook-length document” titled “Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures”, in case you forgot. It’s a little difficult to quickly distill what a supergoal is, despite it being defined in the appendix. It’s one of two things:

    1. A big picture type of goal that might require making “smaller” goals to achieve. In the literature this is also known as a “parent goal” (vs. a “child goal”)
    2. An “intrinsically desirable” world (end) state, which probably requires reaching other “world states” to bring about. (The other “world states” are known as “subgoals”, which are in turn “child goals”)

    Yes, these two things look pretty much the same. I’d say the second definition is different because it implies some kind of high-minded “desirability”. It’s hard to quickly figure out if Yud actually ever uses the second definition instead of the first because that would require me reading more of the paper.

    is a normal emotion, leaves a normal subjective trace, and is fairly easy to learn to identify throughout the mind if you can manage to deliberately "catch" yourself doing it even once.

    So Yud isn’t using “supergoal” on the scale of a world state here. Why bother with the cruft of this redundant terminology? Perhaps the rest of the paragraph will tell us.

    Anyway this first sentence is basically the whole email. “My brain was able to delete ego gratification as a supergoal”.

    Once you have the basic ability to notice the emotion,

    Ah, are we weaponising CBT? (cognitive behavioral therapy, not cock-and-ball torture)

    you confront the emotion directly whenever you notice it in action, and you go through your behavior routines to check if there are any cases where altruism is behaving as a de facto child goal of ego gratification; i.e., avoidance of altruistic behavior where it would conflict with ego gratification, or a bias towards a particular form of altruistic behavior that results in ego gratification.

    Yup we are weaponising CBT.

    All that being said, here’s what I think. We know that Yud believes that “aligning AI” is the most altruistic thing in the world. Earlier I said that “ego gratification” isn’t something on the “world state” scale, but for Yud, it is. See, his brain is big enough to change the world, so an impure motive like ego gratification is a “supergoal” in his brain. But at the same time, his certainty in AI-doomsaying is rooted in belief of his own super-intelligence. I’d say that the ethos of ego-gratification has far transcended what can be considered normal.

  • Kind of a fluff story (archive) where salty’s douchiness is on full display.

    I referenced it because fake book titles are throwaway jokes, you can reference something hyperspecific and not have to worry about whether or not someone will get it, because they might not even notice it at all.

  • Man, knowing nothing else about your coworker, they sound like a completely joyless person. Coming up with fake titles for things is like, such a high fun-to-effort ratio. “Creativity and the essence of Human Experience” by Chat GPT. Boom, there’s one. “Cooking With Olive Oil” by Sam Altman. “IQ184” by Harukiezer Murakowsky. This is so fun and easy that it’s basically hack outside of situations where it is solicited.

  • FWIW my understanding is the "Off"-ness is just decreasing theatre size, but gets (mis)construed as less prestige/fame/quality etc. Fame is probably fine for construing, but prestige/quality is orthogonal. Like you could conceivably have absolute theatre mega stars do an epoch-defining production in an intimate 50-seat theatre or something, and that would still be "Off-off-broadway".

  • TechTakes @awful.systems

    5 Secret Ways to Use ChatGPT Like an AI Pro (2025 easy prompt guide!)

  • OH that Jack Thompson. Yeah I remember now. Man, on one hand, his actions were at best misguided and at worst totally insane. On the other hand, IMO we wouldn’t know about him if video game people were by any measure calm or reasonable.

  • TechTakes @awful.systems

    Meta announces money pit; Alexrandr tapped to lead

    TechTakes @awful.systems

    OpenAI engineers are flocking to its rival Anthropic. “They let us huff our own farts,” says one

    TechTakes @awful.systems

    Lionsgate: "The AI movies are coming, we swear, they're just stuck in Canada"

    TechTakes @awful.systems

    Google: “after billions of dollars spent, we found a brilliant and innovative way to monetize AI! You’ll never guess what it is!!!”

    TechTakes @awful.systems

    Theranos: First Blood Part II

    TechTakes @awful.systems

    Musk accretes Gebbia, wants to run an AirBnB out of 1600 Pennsylvania

    TechTakes @awful.systems

    What is the charge? Eating an LLM? A succulent chinese LLM? Deepseek judo-thrown out of Australian government devices

    TechTakes @awful.systems

    OpenAI says stealing is wrong and bad unless they do it

    TechTakes @awful.systems

    Musk presses H twice to perform the Nazi salute twice on stage at inauguration.

    TechTakes @awful.systems

    Grimes defends Musk’s gaming honor, for “personal pride”

    TechTakes @awful.systems

    GM avoids reinventing a bus or a train with this one weird trick

    TechTakes @awful.systems

    Are we going to see prediction markets enter mainstream journalism? Taylor Lorenz says yes

    TechTakes @awful.systems

    SF tech startup Scale AI, worth $13.8B, accused of widespread wage theft

    SneerClub @awful.systems

    In which some researchers draw a spooky picture and spook themselves

    Buttcoin @awful.systems

    Gotta pump tuah and dump that thang

    TechTakes @awful.systems

    Elon is constructing a texas compound to trap, err, I mean, house his ex wives and children

    Buttcoin @awful.systems

    Should a man be allowed to sell his soul on the blockchain? (Podcast ep dated 23rd February 2022)

    Buttcoin @awful.systems

    Playing [Texas’s] energy market has become more profitable than mining bitcoin

    TechTakes @awful.systems

    Microsoft says EU to blame for the world's worst IT outage