TLDR: A new IBM study reveals that many enterprises are finding it challenging to effectively implement generative AI, despite significant investments. This struggle presents a substantial opportunity for companies like IBM, which are actively developing and offering integrated AI solutions, services, and accelerators to help organizations overcome these hurdles and realize tangible ROI from their AI initiatives.
Recent studies and reports indicate a growing paradox in the enterprise adoption of generative AI: while investments are soaring, many organizations are struggling to translate these into tangible, scalable results. This challenge, however, is creating a fertile ground for technology giants like IBM, which are strategically positioning themselves as key enablers for successful AI integration.
According to a global study by the IBM Institute for Business Value, published on May 6, 2025, surveyed CEOs are deeply committed to advancing AI solutions, with expectations for AI investment growth rates to more than double in the next two years. A significant 61% of CEOs confirmed active adoption of AI agents and plans for large-scale implementation. The study highlights that 68% of CEOs see integrated enterprise-wide data architecture as crucial for cross-functional collaboration, and 72% view their proprietary data as vital for unlocking generative AI’s value. However, a notable finding is that half (50%) of the respondents admit that the rapid pace of recent investments has led to disconnected, piecemeal technology environments.
This sentiment is echoed in a ZDNET report from December 3, 2024, which, citing a Menlo Ventures survey of 600 IT decision-makers, stated that “more than a third of our survey respondents do not have a clear vision for how generative AI will be implemented across their organizations.” Despite this uncertainty, enterprise investments in AI applications surged eight-fold in 2024, reaching nearly $14 billion, with AI-generated code leading the way. The report suggests that this lack of clarity indicates “we’re still in the early stages of a large-scale transformation”.
IBM is actively addressing these enterprise pain points. On June 25, 2025, IBM announced the simplification of its enterprise data stack for the Gen AI era, introducing software designed to unify, govern, and activate unstructured enterprise data essential for powering AI agents and other advanced AI applications. Further demonstrating its commitment, IBM introduced new AI Integration Services on March 17, 2025, aimed at helping clients transform end-to-end business processes with agentic AI.
A separate IBM research, highlighted by CIO Dive on January 8, 2025, revealed that engineers tasked with developing AI applications face significant roadblocks in leveraging the necessary tools. The survey, conducted by Morning Consult among over 1,000 U.S.-based enterprise AI developers, found that while high performance, flexibility, and ease of use are critical for enterprise tooling, these traits are also the rarest among available solutions. Developers often cite a lack of standardization, difficulty in developing ethical lifecycles, and the need for customization as primary inhibitors. On average, enterprise developers use between five and 15 tools for AI application creation, with over 10% using 15 or more.
IBM Vice Chairman Gary Cohn, in the foreword of the May 2025 study, emphasized the need for courage in embracing risk as opportunity. He stated, “When the business environment is uncertain, using AI and your enterprise data to identify where you have leverage is a competitive advantage. At this point, leaders who aren’t leveraging AI and their own data to move forward are making a conscious business decision not to compete.”
Also Read:
- Retail Sector Accelerates AI Integration Amidst Implementation Hurdles
- Australian and New Zealand Businesses Grapple with Infrastructure Deficiencies Amidst Agentic AI Investment Surge
The challenges faced by enterprises in operationalizing generative AI, coupled with their continued commitment to investment, underscore a significant market opportunity for providers of comprehensive AI solutions. IBM, with its focus on integrated data architectures, specialized services, and addressing developer complexities, appears well-positioned to capitalize on this evolving landscape.
