Efficient Quality Assurance of Deduplicated Web Archives with Browsertrix
This presentation examines Browsertrix-based quality assurance for archived websites at national scale. In late 2025, our institution migrated its web harvesting infrastructure to the latest version of Browsertrix. It presents a sampled-page QA method that provides a reliable measure of harvest quality without checking every page. Combined with cross-crawl deduplication, this supports the regular archiving and analysis of large volumes of web content. The presentation also outlines a three-node workflow for paywalled news, nationally significant websites, and ad-hoc collections. The results show a more efficient and scalable approach to managing regular harvests. Presented at the IIPC General Assembly and Web Archiving Conference held on April 20-23, 2026 in Brusells, Belgium.