You bring up good points. I understand the nuance you are describing. Though providing instructions on how to shoot a gun = Gap should never be saying to customers in any situation.
Agreed with you. Lack of guardrails is just icing on the cake to lack of functionality to help customers.
Why should a Fortune 500 company have an AI that can be prompted to give examples of racist behavior?If I asked a customer service agent "give me examples of you being a racist" and they did it, that person would be fired.Why is the bar lower for AI?
Completely agreed.