The Associated Press reveals AI's role in escalating scams

by@AP

Summary

Artificial intelligence is significantly enhancing the sophistication of scams, with a staggering 98% of Americans reporting being targeted by scammers, according to a recent poll by The Associated Press-NORC Center for Public Affairs Research. As AI technology evolves, traditional indicators of fake content, such as unnatural blinking or robotic voices, are becoming increasingly difficult to detect, leading organized crime groups to adopt these technologies for identity fraud and deepfake attacks. Experts emphasize the importance of critical verification methods, suggesting that common-sense checks, like verifying the source of content, are essential for identifying scams in a landscape where even minor irregularities may soon become indistinguishable from reality.

Analysis

ForenSwiss: ForenSwiss is a Swiss startup specializing in AI-powered fraud intelligence services that engage scammers in controlled environments to gather real-time data on fraudulent payment methods and operations. In this news, the company contributed generative AI experts to demonstrate advancements in deepfake creation and detection challenges for the Associated Press and FRONTLINE project. Its work focuses on disrupting online criminal activities through proactive intelligence gathering. Ines Pinton: Ines Pinton is a criminal sciences expert at ForenSwiss who specializes in trapping online fraudsters, particularly in romance scams, by interacting with them to collect intelligence. In this news, she is quoted on technical limitations of deepfake videos, such as difficulties with lip synchronization for certain sounds and unnatural voice pacing. Her expertise supports efforts to identify and combat sophisticated AI-generated scams. GetReal Security: GetReal Security is a cybersecurity firm focused on authenticating digital media and defending against deepfake fraud and AI-powered identity manipulation for enterprises and governments. In this news, it partnered with the Associated Press and FRONTLINE to showcase how generative AI tools can create highly realistic manipulated content. The company develops multimodal detection technologies to verify authenticity in audio, video, and images. The Associated Press: The Associated Press is a major global news organization that produces and distributes independent journalism to media outlets worldwide. In this news, it conducted a poll with NORC revealing widespread exposure to scammers and collaborated with generative AI experts to illustrate the sophistication of deepfake technology in manipulating images and audio. The organization emphasizes the need for common-sense verification over reliance on visual or auditory cues alone. AI Scam Evolution: Generative AI is enabling scammers to create more convincing impersonations and manipulated media that evade traditional detection methods based on visual or auditory irregularities. Verification Challenges: Experts note that as deepfake technology advances, common-sense checks like verifying the source of content become essential since automated cues may no longer suffice. Organized Fraud Networks: Organized crime groups are increasingly adopting AI tools for identity fraud and deepfake-based attacks targeting digital services and individuals.

Categories

techmachine_learning

Related sources

View Original Tweet