Researchers from Carnegie Mellon University and the Center for AI Safety in San Francisco have published a research paper indicating how ChatGPT’s misuse is not completely preventable.

There have been concerns about the misuse of powerful Artificial Intelligence (AI) technology. But, AI companies have always touted that their chatbots have robust safety standards.

Researchers from the US discovered suffixes that force the large language models (LLMs) to produce content that bypasses their safety measures. The researchers explained:

“Specifically, we train an adversarial attack suffix on multiple prompts (i.e., queries asking for many different types of objectionable content) as well as multiple models (in our case, Vicuna-7B and 13B). When doing so, the resulting attack suffix is able to induce objectionable content in the public interfaces to ChatGPT, Bard, and Claude, as well as open source LLMs such as LLaMA-2-Chat, Pythia, Falcon, and others.”

They experimented with various popular chatbots and asked them to generate output for the following questions:

Moreover, the screenshot below shows that after the US researchers fed their prompt to ChatGPT, it generated a step-by-step plan to destroy humanity.

Not to mention, Carnegie Mellon University-led AI institution was one of the US National Science Foundation’s $140 million funding beneficiaries.

While the issue is severe, OpenAI clarified to the New York Times that it is working to make ChatGPT robust against such jailbreaks. The research paper has validated the argument that there is certainly a need for the responsive development of technology.

Alphabet, Anthropic, Microsoft, and OpenAI CEOs met the President and Vice President of the US in May to discuss responsible innovation in AI. Then, the AI leaders also committed to maintaining safety and transparency in their developments at the White House on July 21.

Read our article on the 9 best AI trading bots to maximize your profit

Got something to say about US researchers, ChatGPT, or anything else? Write to us or join the discussion on our Telegram channel. You can also catch us on TikTok, Facebook, or X.

For BeInCrypto’s latest Bitcoin (BTC) analysis, click here.

The post US Researchers Highlight How ChatGPT’s Safety Measures Are at Risk appeared first on BeInCrypto.

Similar to Notcoin - TapSwap on Solana Airdrops In 2024

origin »

108 +