Generative AI services are hugely popular among both internet users and cybercriminals. According to the FBI, "synthetic" content is increasingly being used to commit various frauds. However, individuals can still effectively protect themselves online as long as they take the right precautions.
The FBI has issued a warning about the criminal misuse of artificial intelligence-generated technology. In a recent public service announcement, the bureau warned Americans that fraudsters are using artificial intelligence-generated content to make their illegal schemes more convincing and effective.
According to the FBI, generative AI enables criminals to reduce the time and effort required to deceive targets. These artificial intelligence tools "synthesize" entirely new content based on user-entered prompts. They can even help correct human errors that might raise suspicion, especially in AI-generated text.
Creating content using artificial intelligence is not inherently illegal, but it becomes a crime when that content is used for fraud or extortion attempts. The FBI alert outlines several examples of how generative AI can be misused and provides practical advice to help users keep themselves safe online.
In social engineering or spear phishing campaigns, AI-generated text looks extremely convincing. Fraudsters are leveraging AI-generated technology to churn out fake content, create fake social media profiles, send messages, and translate languages with greater accuracy and fewer grammatical errors. Entire fraudulent websites can now be set up in record time, and chatbots are used to trick victims into clicking on malicious links.
There is no doubt that AI-generated images are at the forefront of current trends, and cybercriminals are taking full advantage of them. Fraudsters are using AI-generated visuals to enhance fake social media profiles and fake identity documents to support fraudulent activity. According to the FBI, artificial intelligence algorithms can generate "realistic" images that are being used in social engineering campaigns, spear phishing, scams and even "killing pans."
AI-generated audio and video content poses similar risks. Criminals can now impersonate public figures or even the target themselves, requesting financial assistance or accessing sensitive information such as bank accounts.
The FBI advises users to establish a "secret word" or phrase with trusted family and friends as a quick way to verify identity. Other tips for protecting against generative AI crimes include carefully checking images and videos for anomalies or inconsistencies, and minimizing the availability of personal images or recordings online.
When handling financial requests, the FBI stresses the importance of verifying their legitimacy through direct phone calls rather than relying on texts or emails. Never share sensitive information with people you’ve only met online. While this may seem obvious, the FBI also reiterates that sending money, gift cards, or cryptocurrency to strangers online is highly risky and often leads to scams.