It was last year when Anthropic increased fears around AI by announcing that Claude Opus 4 had threatened to reveal the extramarital affair of a fictional executive...
If these people still don’t understand the direct link between training data and, ultimately, the outputs of the model, they should not be working with “tools” that can fuck up both people and countries.
I’m tired of AI being the biggest pass-the-buck scheme in history.
I’m tired of AI being the biggest pass-the-buck scheme in history
For real, it’s ridiculous. They’re trying to pass all accountability to something that can never be held accountable. There’s already plenty of stories of AI making some shit ass decision and human operators being unable to intervene, anywhere from it deleting a database to denying a health insurance claim, and no one is held responsible. And the AI will be like “you’re absolutely right to call me out on that, I shouldn’t have killed those children. My bad, I’ll do better next time”
“you’re absolutely right to call me out on that, I shouldn’t have killed those children. My bad, I’ll do better next time”
Is also just a function of training data. There are no consequences in part because it’s not even a real apology: these systems are not conscious, no matter what certain bad actors want you to think. They are purely algorithms running on vectors between tokens on a massive amount of data. They are, at their core, mimics. The user ascribes value to the responses, because we are not used to things that sound so much like us.
At a certain point, they need to be considered a risk to the public health and the public good. I’d argue we are already beyond that point, but with so many investors still expecting return (without even understanding what they’ve invested in), it’ll just be like screaming into the void forever.
I think there is an impending underwriting apocalypse for LLMs that’s going to end the party. Companies want insurance, and insurance companies assess risk. They’re going to need someone to blame when things go expensively wrong with AI, or the insurance policies will have to pay out, and they really don’t like doing that.
If these people still don’t understand the direct link between training data and, ultimately, the outputs of the model, they should not be working with “tools” that can fuck up both people and countries.
I’m tired of AI being the biggest pass-the-buck scheme in history.
For real, it’s ridiculous. They’re trying to pass all accountability to something that can never be held accountable. There’s already plenty of stories of AI making some shit ass decision and human operators being unable to intervene, anywhere from it deleting a database to denying a health insurance claim, and no one is held responsible. And the AI will be like “you’re absolutely right to call me out on that, I shouldn’t have killed those children. My bad, I’ll do better next time”
Yep. And that shit:
Is also just a function of training data. There are no consequences in part because it’s not even a real apology: these systems are not conscious, no matter what certain bad actors want you to think. They are purely algorithms running on vectors between tokens on a massive amount of data. They are, at their core, mimics. The user ascribes value to the responses, because we are not used to things that sound so much like us.
At a certain point, they need to be considered a risk to the public health and the public good. I’d argue we are already beyond that point, but with so many investors still expecting return (without even understanding what they’ve invested in), it’ll just be like screaming into the void forever.
I think there is an impending underwriting apocalypse for LLMs that’s going to end the party. Companies want insurance, and insurance companies assess risk. They’re going to need someone to blame when things go expensively wrong with AI, or the insurance policies will have to pay out, and they really don’t like doing that.