TLDR: Generative AI tools are dramatically lowering the cost and increasing the frequency of bot network attacks on social media, making it harder for platforms to detect sham accounts and posing significant challenges for corporations and cybersecurity. Experts warn that by 2030, bots could generate 90% of internet traffic, necessitating new identity verification methods.
Generative Artificial Intelligence (AI) is ushering in a new era of digital manipulation, significantly reducing the cost and escalating the frequency of bot network attacks across social media platforms. This alarming trend, highlighted in recent reports, is creating unprecedented challenges for corporations, social media platforms, and the broader cybersecurity landscape.
Historically, bot network deployments on social media were primarily the domain of sophisticated fraudsters and state-backed actors. However, the advent of generative AI capabilities over the past one to two years has democratized these attacks, making them more accessible and common. These AI-powered bots are now influencing public opinion and targeting major brands, as evidenced by ‘culture wars’ attacks following Cracker Barrel’s logo change and Amazon’s and McDonald’s diversity, equity, and inclusion policy adjustments.
Rick Song, CEO and co-founder of Persona, emphasized the growing difficulty in distinguishing between malicious and benign bots in the age of agentic AI, a distinction he deems ‘crucial to determine.’ Social media platforms, despite years of effort to eradicate fake accounts, are finding it increasingly challenging to detect these sham accounts due to the continuous evolution of fraudsters’ tactics, now supercharged by AI.
Escalating Cybersecurity Risks and Social Engineering
The impact of generative AI extends beyond social media, accelerating broader cybersecurity risks and social engineering campaigns. CrowdStrike’s ‘2025 Threat Hunting Report’ indicates that threat actors are increasingly leveraging GenAI tools to enhance their malicious activities. The Palo Alto Networks’ 2025 Unit 42 Global Incident Response Report revealed that over one-third (36%) of incident responses originated from social engineering tactics.
Voice phishing (vishing) has seen explosive growth, with CrowdStrike’s 2025 Global Threat Report noting a 442% increase between the first and second halves of 2024. While early AI-driven attacks often involved basic social engineering, such as using ChatGPT for phishing emails, the sophistication is rapidly advancing towards ‘technical’ AI attacks. The Unit 42 report states, ‘Threat actors are now using generative AI to craft personalized lures, clone executive voices in callback scams and maintain live engagement during impersonation campaigns.’
Social engineering, often referred to as ‘human hacking,’ remains the leading cause of network compromise, according to the Information Systems Audit and Control Association (ISACA) 2022 Report. IBM’s ‘Cost of a Data Breach Report 2025’ further identifies breaches caused by social engineering as among the most costly. These attacks typically involve four phases: the ‘Bait’ (researching targets using publicly available information, including social media), the ‘Hook’ (psychological manipulation), the ‘Attack’ (tricking users into divulging sensitive information or executing malicious code), and the ‘Escape’ (disappearing or using scare tactics to silence victims).
The AI-Driven Social Media Landscape
AI tools have become deeply integrated into social media, influencing content creation, consumption, and engagement. In 2025, approximately 5.45 billion people, representing 67.1% of the global population, are active on social media, a significant increase from 4.72 billion in 2023. Users spend an average of 2 hours and 24 minutes daily on these platforms, a 5% rise from the previous year.
Over 80% of social media content recommendations are now powered by AI algorithms, and an estimated 70% of social media images are AI-generated. A substantial 60% of U.S. companies utilize generative AI tools to maintain a 24/7 social media presence, and around 54% of long-form LinkedIn posts are reportedly assisted or influenced by generative AI. Marketers are also embracing AI, with 60% planning to use it in influencer marketing campaigns in 2025, and 71% already embedding AI tools in their strategies, noting that AI-generated content often outperforms non-AI versions.
However, this proliferation of AI content is eroding user trust. Only 41% of Americans believe what they read online is accurate and human-made, and a staggering 78% find it harder than ever to differentiate between human and AI-generated content.
Recommendations for Brands
Also Read:
- World Economic Forum Warns: Unsecured AI Agents Unleash Sophisticated Cyberthreats on Businesses
- Generative AI Tools Linked to Widespread Sensitive Data Exposure in Early 2025
While brands may not be able to entirely halt these AI-driven bot attacks, understanding their nature is crucial. Reports suggest that by recognizing attacks as bot-driven, brands can avoid engaging with bot-generated posts, discern between human and non-human complaints, and be prepared for their decisions to be targeted by automated campaigns on social media. The increasing prevalence of bots, with projections indicating they could generate 90% of internet traffic by 2030, underscores the urgent need for new identity paradigms and robust defense strategies in the digital realm.
