Rethinking National Data Repositories: A Services-First Approach to Unlocking True Value
By Dale Blue | Katalyst Data Management
National Data Repositories (NDRs) are becoming increasingly vital to the energy sector’s digital infrastructure. As countries seek to modernize their resource governance, attract investment, and support evolving national energy strategies, NDRs play a pivotal role in managing subsurface data. Their importance is only accelerating as advances in artificial intelligence and machine learning demand higher volumes of well-organized, accessible data. Yet despite their growing relevance, too many NDR implementations fall short of expectations—over budget, behind schedule, and misaligned with the real needs of their stakeholders.
So why do so many NDR implementations fail to meet expectations? It often comes down to one fundamental misconception: the belief that an NDR is first and foremost a technology project. In reality, successful NDRs are service delivery programs. Technology plays an essential enabling role, but the real value lies in how effectively the NDR delivers data services to support regulation, investment, and collaboration across a nation’s petroleum industry.
A Century of Evolution—and a Critical Misstep
NDRs didn’t start as digital platforms. They began in the early 20th century as physical archives—storing paper well logs and seismic records. By the 1970s, those archives evolved into digital databases as computers transformed the oil and gas industry. But the shift to digital created new challenges: data silos, duplicated records, and a lack of interoperability.
In the 1990s, countries like Norway and the UK began building centralized repositories to enable data stewardship at scale. These early systems were built by seismic services companies that had hands-on experience managing massive data volumes. Their focus was on operational workflows and regulatory compliance, not flashy software features. The result was pragmatic, high-volume data management systems that delivered clear value.
Unfortunately, that approach began to change in the 2000s. Software companies moved into the space, often acquiring former service providers, and the narrative shifted. NDRs were reimagined as platforms driven by features and automation. In many cases, the outcomes failed to live up to the promise, especially when the technology was decoupled from the actual services regulators and industry needed.
What an NDR Really Is—and Isn’t
An NDR should be viewed as a national data governance program. It combines legal frameworks, operational models, expert services, and enabling infrastructure to ensure that subsurface data is preserved, accessible, and usable across the lifecycle of a country’s energy industry.
Done right, an NDR enables regulators to monitor compliance, supports bid rounds with quality-controlled data, empowers national oil companies with access to legacy data, and provides academia and civil society with transparency and insight. But this only happens when the NDR is active and service-led, not just a passive data warehouse or static software deployment.
Critically, an NDR is not:
- Just a software solution
- A one-time implementation
- A backend archive with minimal engagement
It is an ongoing program that requires stewardship, adaptability, and alignment between policy, operations, and technology.
The Dual Mission of Every NDR
Every NDR serves two core functions: regulatory oversight and investment promotion. Some countries manage both through a single agency; others split the responsibilities. Either model is viable, if the NDR is designed to support both objectives with scalable, modular services.
The key is to recognize the diversity of stakeholders involved. Regulators need tools to monitor submissions and enforce compliance. National oil companies need historical data for planning. International operators need discoverability and clarity to evaluate opportunities. Service providers need to interact with the repository to expand offerings. And researchers, educators, and civil society benefit from accessible, transparent data.
Why Software-First Approaches Miss the Mark
Too often, NDR procurement follows an IT-centric path—defining success in terms of features, button clicks, and system specifications. This leads to bloated RFPs with hundreds of technical requirements, but little focus on how those systems will actually serve users or deliver business outcomes.
The result? Cost overruns, delays, integration failures, and platforms that don’t support core workflows. One-size-fits-all solutions frustrate stakeholders with disconnected features and inflexible tools. Worse, the long-term value of the NDR gets lost when users struggle to retrieve or apply the data in meaningful ways.
A Better Way Forward: Services First, Technology Second
At Katalyst, we believe the right way to approach an NDR is by starting with the services. What are the specific workflows and business needs of the country’s regulatory and investment promotion teams? What are the pain points of data users in each stakeholder group? Once these needs are clearly defined, only then should technology be introduced—custom-fit to support those workflows efficiently and at scale.
This approach results in:
- Alignment between service requirements and system capabilities
- Scalable infrastructure that grows with user needs
- User-centric tools that enhance productivity
- Measurable outcomes tied to real-world performance
This isn’t just a theory. It’s how we operate every day. Katalyst manages over 100 petabytes of subsurface data—the largest collection of its kind—across millions of seismic surveys and wells. Our technology was built not to be sold as a product, but to meet our own service delivery needs. That’s why our iGlass NDR solution is purpose-built to enable the full lifecycle of regulatory and investment promotion services.
Closing the Gap Between Vision and Reality
For governments and regulators, the first step is clear: stop treating NDRs as procurement exercises for software and start viewing them as national service delivery programs. Define the services first. Then select partners who understand not just how to build systems, but how to deliver them in the context of real petroleum data workflows.
For operators, investors, and industry partners: insist on systems that are proven at scale and aligned with the data needs of today’s energy economy. Your ability to explore and develop depends on it.
A modern NDR isn’t just a data warehouse. It’s a dynamic, evolving system of services that can shape the future of a country’s energy sector.
Let’s build them that way.
To learn more or to schedule a demo, please contact us.
Resource: https://www.katalystdm.com/webinars/
