TLDR: WalletHub, a personal finance website, has blocked Google and other AI companies from crawling over 40,000 of its web pages. The company alleges that these AI entities are ‘stealing’ and repackaging its content without providing adequate attribution or traffic, thereby undermining the traditional web ecosystem. This move follows growing concerns among publishers regarding AI’s use of copyrighted material.
In a significant move against the burgeoning influence of artificial intelligence in content dissemination, personal finance platform WalletHub has announced it has restricted Google and other AI developers from accessing more than 40,000 of its web pages. The company cites concerns over what it describes as ‘AI-fueled plagiarism’ and ‘content theft,’ arguing that AI models are ingesting its content and then presenting slightly modified versions without proper attribution or returning traffic to the original publishers.
Odysseas Papadimitriou, CEO of WalletHub, articulated the company’s frustration, stating, ‘Google went from organizing the world’s information to stealing it, taking a sledgehammer to the implied contract the open web has relied on for so long.’ He further elaborated that the long-standing agreement has been that publishers grant search engines access to their content in exchange for visibility in search results. However, Papadimitriou contends that ‘Now, Google and other AI-powered companies are taking the content and giving almost nothing back in return. A lot of AI content is just copyright infringement hiding behind the veil of technological progress.’
Unlike some other ongoing legal battles, WalletHub is not accusing Google of direct, verbatim plagiarism. John Kiernan, managing editor of Miami-based WalletHub, clarified to American Banker, ‘They’re essentially putting a handful of websites’ content in the blender and producing content in their own search results, and essentially pushing the publishers themselves aside. So they’re basically repackaging the content as their own.’ This practice, WalletHub argues, constitutes anticompetitive behavior by scraping content without providing the necessary traffic or revenue to the original creators.
To implement the block, WalletHub is reportedly collaborating with Cloudflare, a content delivery network provider that introduced an option to block AI crawlers in September 2024. While specific technical details of the blocking mechanism were not disclosed, the company acknowledges that this action might reduce its visibility to potential new customers or partners.
Also Read:
- Yomiuri Shimbun Initiates Legal Action Against Perplexity AI Over Copyright Infringement
- Mediavine Urges U.S. Copyright Office for Stronger Creator Protections Against Generative AI
This action by WalletHub is part of a broader trend of content creators pushing back against AI companies. It follows high-profile copyright infringement lawsuits, such as the one brought by The New York Times, The New York Daily News, and eight other newspapers against Microsoft and OpenAI for training AI models with their articles. That case has been allowed to proceed by a Manhattan federal district court, and similar suits have been filed by book authors. The core issue revolves around the economic impact on publishers and the legal implications of using copyrighted material to train generative AI models, which then produce content that competes with the original sources.
