WormGPT, FraudGPT: How Cybercriminals are Taking Over Generative AI

Marc Bolle
3 min readAug 20, 2023

--

Image by Tima Miroshnichenko on Pexels

The increasing use of generative AI has opened up new opportunities while also introducing new cybersecurity dangers. As recent activity on the Dark Web Forum show, cybercriminals have quickly adopted generative AI to improve their attacks, including tools like WormGPT and FraudGPT.

WormGPT: the Dark Side of ChatGPT

On July 13th, researchers from the cybersecurity company SlashNext uncovered new tool, known as WormGPT, which is presented as “similar to ChatGPT but without ethical boundaries.”

WormGPT has been developed on GPT-J open-source language model (Generative Pre-Trained Transformer with JAX built by EleutherAI in 2021), using various data sources, including information about cyberattacks and malicious software.

While ChatGPT has usage limitations, WormGPT can assist users in engaging in various malicious acts and illegal activities. WormGPT is essentially ChatGPT without moral restrictions.

Boundless Potential for Harm

For example, WormGPT can be used to automate the creation of highly convincing deceptive emails. Because these emails are highly personalized for the recipients, they can be used to deceive someone into sending money or sensitive information.

WormGPT can also be used to craft malicious code that steals sensitive information from a user’s device, or ransomware that encrypts files and demands payment to unlock them.

The researchers at SlashNext were able to employ WormGPT to “compose an email aimed at convincing an unsuspecting account manager to pay a fraudulent invoice.” They were astonished by how effectively the language model accomplished this task, labeling the outcome as “remarkably persuasive and strategically clever as well.”

Monetizing Malice

The developer of WormGPT is crafting a subscription model for access, ranging from $60 to $700.

Screenshot of WormGPT showing a user request asking the model to produce a Python malware.

FraudGPT: The Malicious Alternative to ChatGPT

Netenrich, a security and operations analytics business, also found the presence of another malicious malware called FraudGPT.

Since July 2023, this AI model has been circulating on Telegram Channels, allowing any cybercriminal to undertake complex attacks that were previously reserved for coding and hacking experts.

On June 23, 2023, the person behind this tool, identified as “CanadianKingpin,” launched a Telegram channel to promote their model. He argues, “Look no further if you are looking for a ChatGPT alternative designed to offer an expansive array of tools, features, and exclusive capabilities tailored for boundary-pushing individuals!”

Easy Access through Subscription

FraudGPT can be found on dark web marketplaces such as Alphabay, Empire, Torrez, Versus, WHM, and World. It is sold on a subscription basis, with costs starting at $200 per month, $1000 for six months, and $1700 annually.

Empowering Cybercriminals with Unprecedented AI Capabilities

Among the features of FraudGPT is the ability to generate malicious code to exploit weaknesses in computer systems, applications, and websites. It creates malware that evades conventional security measures.

Furthermore, FraudGPT may generate convincing phishing pages that confuse users by replicating authentic websites, increasing the success of phishing attempts.

FraudGPT also allows for the discovery of Non-Verified By Visa bins (Non-VBV), which simplifies unauthorized transactions by eliminating the need for additional security checks.

FraudGPT can also be used to identify weaknesses and data leaks within target infrastructures, facilitating security breaches.

It also helps cybercriminals find hidden hacker groups, covert websites, and black marketplaces where stolen data is traded.

Screenshot of FraudGPT showing a user request asking the model to produce a SMS spam.

Conclusion

The emergence of these tools raises concerns about their potential misuse and their implications for online security. It highlights the need of remaining vigilant in the face of evolving cyber threats and the importance of staying informed about such developments.

--

--