Skip to content
Industry · Oct 25, 2026

AI inference’s data storage burden grows faster than compute budgets, survey and measurements show

Enterprise storage outpaces compute spending as inference scales, with back-end data footprints up to 130 times larger than user-facing outputs, according to WD-sponsored IDC survey and internal measurements.

Trust75
HypeLow hype

1 source · cross-referenced

ShareXLinkedInEmail
TL;DR
  • Enterprise AI costs are increasingly dominated by storage as inference scales, not just compute.
  • WD-sponsored IDC survey of 763 IT leaders found 95% saw data volume rise due to generative AI in the past year.
  • Internal WD measurements show an 8-second AI video leaves >500MB of back-end data vs. a 3.97MB user output.
  • McKinsey projects inference demand will grow 35% CAGR through 2030, outpacing training’s 22% growth.
  • 96% of respondents anticipate needing faster archive retrieval to support inference or RAG.

Ask most executives to picture the cost of AI and they’ll likely see racks of accelerators and gigawatts of power, but the picture often leaves out data storage costs. What happens to data after a model responds? Much of the back-end data generated from billions of daily prompts, images, and videos needs to be stored, yet storage is one of the harder infrastructure costs to plan for and is frequently overlooked in initial AI infrastructure planning.

Inference runs continuously, unlike training runs that are finite and project-based. Every inference request leaves something behind, and for AI-generated video, the back-end spend can be significant. Internal measurements by WD found that an 8-second clip returned to a user as a 3.97MB 720p file left more than 500MB of associated data on the back end, including logs, cached context, immediate renders, backups, and safety records. That’s a 130x increase over the output file size the user saw. Scale this to longer, higher-resolution video and the back-end footprint grows into the hundreds of gigabytes per clip.

McKinsey projects AI inference demand will grow at a 35% compound annual growth rate through 2030, compared with 22% for training, making inference more than 40% of total data center demand by the end of the decade. A WD-sponsored IDC global white paper surveying 763 IT and business decision makers found that nearly 95% reported an increase in data volume due to generative AI over the past 12 months, with roughly 61% reporting growth of 25% or more.

A senior product manager at a hyperscale cloud service provider quoted in the report noted that storage is often optimized to keep GPUs busy: “The biggest challenge is to ensure that the GPUs are not idle, waiting for data to show up—hours of GPU idle time becomes very expensive, very fast.” If storage spend grows 25% year over year while compute budgets grow more predictably, storage can outpace the more visible compute line item.

As more data is retained, retrieved, and reused, storage must support not only growing capacity but increasingly dynamic access. The same WD–IDC survey found 96% of respondents anticipate needing faster archive retrieval to support inference or retrieval-augmented generation workloads. Information that once moved into an archive and rarely surfaced can now become an input to future AI workloads, changing the role of retained data.

For CFOs and CIOs, this means AI infrastructure spend may be scoped too narrowly on compute. A model idling while data loads costs about as much as one idling for lack of a GPU, but the storage bottleneck stays hidden until it surfaces in operating costs and retrieval delays rather than a capital expenditure line next to accelerators.

Addressing this challenge requires architecture designed for the full AI data life cycle, balancing performance with capacity, power, reliability, and total cost of ownership as data persists and compounds. That means treating archives as active assets for RAG and inference and setting retention policies based on strategic value rather than original storage cost.

Sources
  1. 01MIT Technology Review — AI — AI’s hidden storage bill: What inference leaves behind
Also on Industry

Stories may contain errors. Dispatch is assembled with AI assistance and curated by human editors; despite the trust-score filter, mistakes happen. We correct publicly — every article links to its revision history. Nothing here is financial, legal, or medical advice. Verify before relying on any claim.

© 2026 Dispatch. No ads. No sponsorships. No paid placement. Reader-supported via Ko-fi.

Built by a person who cares about honest AI news.