Although there are a few ways to mitigate the risk, the only way to block it is to get AI to differentiate instructions from data, which is impossible today.
I have heard in the past that it’s not possible to fully control AI. Like literally, the people developing and running the AI cannot fully control its behavior. I did a quick search to see if I could find more info and found this link on the first page of results: https://www.eurekalert.org/news-releases/1032090
I think that we’re going to continue seeing unwanted behavior from AI.
Distinguished credentials, but at the same time I am not buying it. You can control AI. You can turn it off. You can have it not interact with systems you don’t want.
Remember this guy is saying “you cant control AI, we are all doomed” while also saying that we live in a simulation and he is very close to being able to hack us out of it.
Grain of salt and all.
By the way his belief is thus “AI can’t be contained, therefore the simulation can be escaped; by contraposition, if the simulation can’t be escaped, AI can be contained” Since AI cant be contained, he reasons, we can escape the simulation, quite possibly by using a super AI!
There might be a reason he has a podcasts and visits Joe Rogan
Thanks, I fully agree that AI can be controlled in the ways you mentioned. I think most of the discussion around AI not being fully controllable is in the context of if the AI is running as it currently is.
Thanks for the additional info too. I knew nothing about the guy in the link. It was just the first link I found on a quick search about AI not being controllable. I had heard it before, but didn’t remember where, or the exact details.
I have heard in the past that it’s not possible to fully control AI. Like literally, the people developing and running the AI cannot fully control its behavior. I did a quick search to see if I could find more info and found this link on the first page of results: https://www.eurekalert.org/news-releases/1032090
I think that we’re going to continue seeing unwanted behavior from AI.
Distinguished credentials, but at the same time I am not buying it. You can control AI. You can turn it off. You can have it not interact with systems you don’t want.
Remember this guy is saying “you cant control AI, we are all doomed” while also saying that we live in a simulation and he is very close to being able to hack us out of it.
Grain of salt and all.
By the way his belief is thus “AI can’t be contained, therefore the simulation can be escaped; by contraposition, if the simulation can’t be escaped, AI can be contained” Since AI cant be contained, he reasons, we can escape the simulation, quite possibly by using a super AI!
There might be a reason he has a podcasts and visits Joe Rogan
Thanks, I fully agree that AI can be controlled in the ways you mentioned. I think most of the discussion around AI not being fully controllable is in the context of if the AI is running as it currently is.
Thanks for the additional info too. I knew nothing about the guy in the link. It was just the first link I found on a quick search about AI not being controllable. I had heard it before, but didn’t remember where, or the exact details.