It’s not better than nothing - it’s worse than nothing. It is actively harmful, feeding psychosis, and your chat history will be sold at some point.
Try this, instead of asking “I am thinking xyz”, ask " my friend thinks xyz, and I believe it to be wrong". And marvel at how it will tell you the exact opposite.
I’m fairly confident that this could be solved by better trained and configured chatbots. Maybe as a supplementary device between in-person therapy sessions, too.
I’m also very confident that there’ll be lot of harm done until we get to that point. And probably after (for the sake of maximizing profits) unless there’s a ton of regulation and oversight.
So we know that in certain cases, using chatbots as a substitute for therapy can lead to increased suffering, increases risk of harm to self and others, and amplifies symptoms of certain diagnosis. Does this mean we know it couldn’t be helpful in certain cases? No. You ingested the exact same logic corpos have with LLMs, which is “just throw it at everything”, and you seem to not notice you apply it the same way they do.
We might have enough data at some point to assess what kinds of people could benefit from “chatbot therapy” or something along those lines. Don’t get me wrong, I’d prefer we could provide more and better therapy/healthcare in general to people, and that we had less systemic issues for which therapy is just a bandage.
it’s worse than nothing
Yes, in total. But not necessarily in particular. That’s a big difference.
If you have a drink that creates a nice tingling sensation in some people and make other people go crazy, the only sane thing to do is to take that drink off the market.
Yeah but that applies to social media as well. Or, idk, amphetamine. Or fucking weed. Even meditation. Which are all still there, some more regulated than others. But that’s not what you’re getting at, your point is AI chatbots = bad and I just don’t agree with that.
It’s not better than nothing - it’s worse than nothing. It is actively harmful, feeding psychosis, and your chat history will be sold at some point.
Try this, instead of asking “I am thinking xyz”, ask " my friend thinks xyz, and I believe it to be wrong". And marvel at how it will tell you the exact opposite.
I’m fairly confident that this could be solved by better trained and configured chatbots. Maybe as a supplementary device between in-person therapy sessions, too.
I’m also very confident that there’ll be lot of harm done until we get to that point. And probably after (for the sake of maximizing profits) unless there’s a ton of regulation and oversight.
I’m not sure LLMs can do this. The reason is context poisoning. There would need to be an overseer system of some kind.
So we know that in certain cases, using chatbots as a substitute for therapy can lead to increased suffering, increases risk of harm to self and others, and amplifies symptoms of certain diagnosis. Does this mean we know it couldn’t be helpful in certain cases? No. You ingested the exact same logic corpos have with LLMs, which is “just throw it at everything”, and you seem to not notice you apply it the same way they do.
We might have enough data at some point to assess what kinds of people could benefit from “chatbot therapy” or something along those lines. Don’t get me wrong, I’d prefer we could provide more and better therapy/healthcare in general to people, and that we had less systemic issues for which therapy is just a bandage.
Yes, in total. But not necessarily in particular. That’s a big difference.
If you have a drink that creates a nice tingling sensation in some people and make other people go crazy, the only sane thing to do is to take that drink off the market.
Yeah but that applies to social media as well. Or, idk, amphetamine. Or fucking weed. Even meditation. Which are all still there, some more regulated than others. But that’s not what you’re getting at, your point is AI chatbots = bad and I just don’t agree with that.