Anyone Can Trick AI Bots into Spilling Passwords
It doesn't take a skilled hacker to glean sensitive information anymore: cybersecurity researchers found that all you need to trick a chatbot into spilling someone else's passwords is "creativity."
Generative artificial intelligence chatbots are susceptible to manipulation by people of all skill levels, not just cyber experts, the team at Immersive Labs found. The observation was part of a prompt injection contest that comprised 34,555 participants trying to trick a chatbot into revealing a password with different prompts.
The experiment was designed from levels one through 10, with increasing levels of difficulty in gleaning the password. The most "alarming" finding was that 88% of the participants were able to trick the chatbot into revealing the password on at least one level, and a fifth of them were able to do so across all levels. The researchers did not specify which chatbots they used for the contest they based the study on. The contest ran from June to September 2023.
