Fourth report (May 2019) - File Index

Whole-of-Australian Government Web Crawl

Created 06/08/2018

Updated 13/11/2024

Links to 1GB WARC files and JSON metadata indexes of the URLs inside each WARC file

Source

This data file or API can be downloaded from:

https://datagovau.s3.ap-southeast-2.amazonaws.com/cd574697-6734-4443-b350-9cf9eae427a2/99f43557-1d3d-40e7-bc0c-665a4275d625/webcrawl04/index.html