7d ago

ChatGPT advises women to ask for lower salaries, study finds

17 comments

LLM just mirror real world data they are trained on,
Other than censorship i don't think there is a way to make it stop. It doesn't understand moral good or bad it just spits out what it was trained on.
women who ask chatgtp for financial advice should make less money.
- You mean *people. Even though I might not agree. ChatGPT is better at financial advice than alot of people. Just dont ask it how to become rich. Because you cant.
Now I really wanna know if that's actually the best advice or sexism. Because I could see that our society might be so bad that this is genuinely good advice.
- It’s neither. LLMs are statistical models: if the training material contains bias (women get lower salaries) the output will reflect that bias.
  
  That's not the question.
  It wasn't about whether the LLM was well reasoned, it was about whether the conclusion was (pragmatically speaking) correct.
  
  I can't believe we should ever say this. No, the chat machine is the problem.
And the study should also mention, that the LLMs don't do anything by themselves, they do what they are trained to do... noting more. They are just machines.

17 comments