TLDR: Google’s AI Overviews are inadvertently directing users to fraudulent customer service numbers, leading to sophisticated scams including voice duplication fraud and financial losses. Experts warn that scammers are manipulating online content to surface fake numbers in AI search results, prompting calls for users to rely solely on official company websites for contact details.
Concerns are mounting over Google’s artificial intelligence tools, specifically AI Overviews, as they are reportedly directing users to fraudulent customer support numbers, leading to a new wave of sophisticated online scams. These incidents highlight a concerning trend in the misuse of AI technology, enabling schemes such as voice duplication fraud and various online traps that can result in significant financial losses for victims.
A notable case involved Alex Rivlin, owner of a real estate firm, who sought Royal Caribbean’s customer service number via Google’s AI Overviews. The number provided was not legitimate but belonged to a scammer. Rivlin, who narrowly avoided being defrauded after sharing credit card details, posted on Facebook, stating, ‘I’m sharing this as a public service announcement. With AI-generated results and spoofed numbers, the game has changed.’
A similar fraudulent activity was reported concerning Southwest Airlines, where a fake number appeared in the AI Overview section. This number, not found on the airline’s official website, was allegedly used by fraudsters attempting to charge customers hundreds of dollars for minor ticket corrections, such as misspelt names.
The issue extends beyond travel companies. Users on Reddit have also reported falling victim to scams after searching for support numbers for food delivery services. One individual almost lost money while seeking helpline assistance, and a 65-year-old man reportedly lost over US$3,000 after searching for ‘Swiggy call centre’ on Google. Despite Swiggy’s repeated warnings on its website that it ‘do[es] not have any official customer care phone lines’ and advises users to ‘Beware of fake numbers,’ Google’s AI Mode results still listed additional ‘customer service contact options,’ including a number for Swiggy’s partner onboarding service and two others not found in official directories. One of these misleading numbers was cited in a complaint on the Consumer Complaints Court website.
Experts suggest that the root of the problem lies in scammers’ manipulation of online forums and user-generated content sites. By saturating these platforms with fake contact information, they increase the probability that AI-powered search tools will surface their fraudulent details. Lily Ray, Vice President of SEO Strategy & Research at Amsive, explained on LinkedIn, ‘Scammers have discovered that they can flood user-generated content sites and forums with fake phone numbers for major businesses, then trick callers into sharing their credit card information.’
Furthermore, reports from Odin and ITBrew indicate that hackers are capable of designing prompts to instruct Google’s Gemini AI to incorporate fraudulent contact details into its summaries. Google has acknowledged these issues and stated that it is actively working to remove unreliable entries from its AI Overviews.
Also Read:
- Gen Digital’s Q2 2025 Threat Report Uncovers Escalation of AI-Driven Cyberattacks and Scams
- AI-Enhanced Social Engineering Emerges as Strategic Threat to Operational Technology Sector
Until more robust safeguards are implemented, experts strongly advise users to exclusively consult official company websites for all helpline numbers and customer service information. This approach, they contend, remains the most reliable defense against the increasingly sophisticated AI-driven scams.
