Be aware of AI scammers

 

Scammers have found a new tool to aid their schemes: artificial intelligence (AI). According to Morgan Wright, chief security adviser for SentinelOne, criminals are feeding data from Snapchat, TikTok, Facebook, and other social media platforms to AI programs to fabricate fake voices and images, which are then used in ransom crimes. Wright warns that social media has become a reconnaissance tool for transnational criminal groups and human traffickers, as they use the information to track potential victims.

Posting real-time locations on social media could also aid criminals in targeting victims when they are separated from their families, Wright added. In the last month, two AI-based blackmail scams happened in Arizona. In both cases, criminals called demanding ransom using AI-generated voices of family members. One victim, Jennifer DeStefano, recounted how she received a call with her daughter's voice, saying, "Mom these bad men have me. Help me, help me, help me." The phony captor demanded ransom, threatening to harm her daughter and drop her in Mexico if she didn't comply.

The speed of the scams and the believability of AI-powered deepfake voices give criminals an edge over their victims, said Wright, who is also a former detective. He explained that scammers isolate victims and don't give them enough time to respond, especially when they believe that their child's life is at stake. In DeStefano's case, the scammers likely knew that she and her 15-year-old daughter were apart at the time, which gave them leverage over the mother.

DeStefano was able to confirm her daughter's safety during the ransom call, but the experience left her and her family frightened. She believes that her story should raise awareness of how AI is used in crimes. Wright said that scams using AI are becoming more common as the tools become more accessible and usable, even by bad actors with little technical skill.

Wright's warning echoes the concerns of many experts in the field of AI, who have been warning about the potential dangers of deepfakes for several years. Deepfakes are AI-generated media that can be used to manipulate public opinion, spread disinformation, and defame individuals. They are becoming increasingly sophisticated, making it difficult to distinguish them from real media. The rise of deepfakes has led to calls for stricter regulations to prevent their misuse.

In addition to deepfakes, scammers could also use generative AI to create convincing phishing emails and fake social media accounts. These techniques are already being used to target individuals and organizations, causing financial losses and reputational damage. With the increasing availability of AI tools, it is essential to educate the public about the risks and provide them with the tools to protect themselves.

To combat the threat of AI-enabled scams, Wright recommends that individuals limit the amount of personal information they share on social media and avoid posting real-time locations. He also advises parents to have a pre-arranged code word or phrase that only they and their children know, which can be used to verify the authenticity of any emergency call. It is also important to remain vigilant and skeptical of any unsolicited phone calls, emails, or messages, especially those that demand immediate action.