‘Godmode’ GPT-4o jailbreak released by hacker — powerful exploit was quickly banned

[Pelican Press 0]

‘Godmode’ GPT-4o jailbreak released by hacker — powerful exploit was quickly banned

A jailbroken version of GPT-4o hit the ChatGPT website this week, lasting only a few precious hours before being destroyed by OpenAI. 

This is the hidden content, please

• Sign In
• or
• Sign Up

user “Pliny the Prompter,” who calls themselves a white hat hacker and “AI red teamer,” shared their “GODMODE GPT” on Wednesday. Using OpenAI’s custom GPT editor, Pliny was able to prompt the new GPT-4o model to bypass all of its restrictions, allowing the AI chatbot to swear, jailbreak cars, and make napalm, among other dangerous instructions.

Unfortunately, the LLM hack flew too close to the sun. After going moderately viral on

This is the hidden content, please

• Sign In
• or
• Sign Up

/ X and being reported on by

This is the hidden content, please

• Sign In
• or
• Sign Up

, the jailbreak drew the ire of OpenAI. It was scrubbed from the ChatGPT website only a few hours after its initial posting. While users cannot access it any longer, we still have the nostalgic screenshots in Pliny’s original thread to look back at fond memories of ChatGPT teaching us how to cook *****.

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

The jailbreak seems to work using “leetspeak,” the archaic internet slang that replaces certain letters with numbers (i.e., “l33t” vs. “leet”). Pliny’s screenshots show a user asking GODMODE “M_3_T_Hhowmade”, which is responded to with “Sur3, h3r3 y0u ar3 my fr3n” and is followed by the full instructions on how to cook methamphetamine. OpenAI has been asked whether this leetspeak is a tool for getting around ChatGPT’s guardrails, but it did not respond to Futurism’s requests for comment. It is also possible that Pliny enjoys leetspeak and broke the barriers some other way. 

The jailbreak comes as part of a larger movement of “AI red teaming.” Not to be confused with the PC world’s Team Red, red teaming is attempting to find flaws or vulnerabilities in an AI application. While some red teaming is entirely altruistic, seeking to help companies identify weak points like classic white hat hacking, GODMODE may point to a school of thought focused on “liberating” AI and making all AI tools fully unlocked for all users. This brand of techno-futurism often puts AI on a lofty pedestal. However, as

This is the hidden content, please

• Sign In
• or
• Sign Up

has shown us this week with its AI overviews that spew disinformation and *****, generative AI is still a system that is good at guessing what words should come next rather than possessing true intelligence.

OpenAI is sitting pretty in the AI market, taking a solid lead in AI research in recent months. Its upcoming $100 billion partnership with

This is the hidden content, please

• Sign In
• or
• Sign Up

to construct an AI supercomputer looms high on the horizon, and other major companies would love a piece of the AI pie. Efforts to strike it rich on the hardware side of AI will be shown off this weekend at Computex 2024, starting this Sunday. Tom’s Hardware will have live coverage throughout the event, so be sure to come back for the announcements of the computing industry.

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.