MIT reported that up to 95% of enterprise AI projects fail. Businesses are racing to adopt the technology and rushing execution in the process, significantly eroding ROI and potentially leaving thousands of businesses at risk of regulatory exposure.
Despite the urgency, there lies an invisible burden which is undermining progress. It is called AI debt and it may be the single greatest obstacle standing between AI ambitions and commercial reality.
AI debt is the accumulated result of incomplete digital transformation. It is every decision which meant legacy infrastructure was never fully retired, or the fragmented data siloes that were never unified. Any new platforms layered on top of such large and complex data sets that haven’t been organised properly, are creating complexity rather than clarity.
On their own, these shortcuts may have seemed pragmatic but collectively, they are now stalling innovation.
The risk of unfinished business
Recent analysis from McKinsey highlights the scale of the missed opportunity. Despite AI tools becoming commonplace today, 63% of organisations reported that they are still experimenting or piloting early-stage AI projects. This shows that most organisations are yet to embed AI deeply enough into their workflows and processes to capture its full value, estimated globally at between $2.6 trillion and $4.4 trillion.
The number one reason for this is years of bolt-on systems that have created tangled IT estates that slow decision-making and make rapid innovation nearly impossible. Running legacy and modern environments side by side inflates maintenance costs and introduces operational confusion which can result in failed implementations. These poorly executed migrations waste capital and introduce security and compliance risk, particularly under regulations such as General Data Protection Regulation (GDPR) and Digital Operational Resilience Act (DORA).
These consequences are measurable. Projects are delayed by months, which has a knock-on effect for budgets. Overall, the whole process inevitably grinds to a standstill because the data required to fuel AI models remains locked away in silos. Estimates suggest that between 50 and 70 per cent of enterprise data remains unconnected and inaccessible for advanced analytics.
The rise of AI debt
The push towards autonomous systems capable of independent decision-making is amplifying this risk of failure. While a majority of organisations plan to deploy AI agents in the near term, only a fraction have centralised their data or ensured their infrastructure can handle the projected surge in workloads.
The statistics are sobering. A recent report from Cisco found that fewer than one in five companies have fully centralised their data for seamless AI access. Over 60 per cent expect workloads to increase by more than 30 per cent within the next few years. Less than a third feel fully prepared to secure agentic AI systems against emerging threats.
Even the most digitally advanced firms are grappling with spiralling compute costs and persistent talent shortages in cybersecurity and AI engineering. In the same way that technical debt slowed software development in the 1990s and 2000s, AI infrastructure debt threatens to stall the current wave of transformation before it delivers meaningful returns.
At its core, AI debt is a data problem. AI systems amplify whatever they are trained on. If the data is incomplete or contextually degraded, the outputs will be flawed, often in ways that appear plausible but lack integrity. This phenomenon, sometimes described as AI slop, is not merely a technical nuisance but a commercial and reputational risk.
This occurs when organisations migrate or modernise without preserving metadata, lineage and governance and so its meaning is lost along with trust. In regulated industries, that erosion has legal implications. In competitive markets, it has revenue implications.
The path forward requires paying down the debt.
Paying off AI debt
At Cirata, we always advise that the best way to eliminate AI debt is to address fragmentation at its source. This means employing a system that can create a unified, interoperable data foundation that supports AI at scale. By decoupling data orchestration from underlying infrastructure, organisations can move, replicate and integrate data seamlessly across on-premises, hybrid and multi-cloud environments without disrupting production systems.
This approach delivers several strategic advantages. Automated data flows across clouds and platforms ensure models are trained and updated with the latest data. Businesses should always look to leverage open standards, such as Apache Iceberg, to prevent vendor lock-in and preserve long-term flexibility.
IT leaders should explore solutions to help them make sense of their data. By centralising governance and eliminating brittle integrations, organisations can feel confident they’ll be on the right side of AI project success. Most importantly, they can break the cycle of making short-term compromises that accumulate into long-term risk.
No algorithm will compensate for structural weakness
The promise of AI remains immense. Autonomous systems and generative models will continue to reshape industries. But no algorithm can compensate for a weak foundation. Just as a building requires structural integrity before additional floors are added, AI requires a unified and trusted data infrastructure before it can deliver sustained value. The organisations that thrive in 2026 and beyond will not be those that launched the most pilots. They will be those that had the discipline to eliminate their AI debt first.
By Stephen Kelly, CEO of Cirata.
- Data & AI