Building the Data-Driven Archive: An Asynchronous, Interoperable, Event-Driven, Low-Code Data Wonderland : Poster - iPRES 2025 - Wellington, New Zealand / Te Whanganui-a-Tara, Aotearoa
Abstract
This poster describes work-in-progress and lessons learned in our move towards a robust, flexible, modern data infrastructure for the digital archive. We have implemented data transformation capability via a low-code commercial ETL tool, and service integration via an asynchronous messaging architecture. This provides powerful but ‘light touch’ interoperability across systems with different maturity, governance, technical architecture and data models. Our next iteration will introduce a centralized, machine-readable data catalogue to enable data-driven processing. The long-term vision is of a full data eco-system (data mesh/data fabric). This approach is highly compatible with archival concerns (intellectual control, integrity, provenance). We find that engaging with data-centric practices has brought greater consistency, efficiency and a fresh perspective on our work as a digital archive.Details
- Creators
- Phil Ashworth; Sonia Ranade; Paul Young
- Institutions
- Date
- 2025-09-01 00:00:00 +0000
- Keywords
- digital humanities
- Publication Type
- poster
- License
- http://creativecommons.org/licenses/by-sa/4.0/
- Download
- 97908 bytes