What’s the current recommended way to download the entire IATI dataset in XML? Separate files are OK.
Serious suggestions though:
If you don’t mind the known issues with the IATI Datastore, or the existence of some wrapper XML including query metadata, this (theoretically) should do the trick as an ultra lazy approach: http://datastore.iatistandard.org/api/1/access/activity.xml?stream=true.
But if you want the exact published xml, this is possibly still the simplest / lowest friction way of downloading all of the datasets in their raw form: https://github.com/IATI/IATI-Registry-Refresher as far as I know.
It provides all IATI data on the registry – unfettered and unfiltered – in a single HTTP request.
I’ll try and make it look a bit more presentable, but let me know if that’s useful.
Great. I have also created another torrent, just in case: https://thepiratebay.org/torrent/22322607/IATI_XML_Snapshot__3_25-05-2018
Currently I download IATI XML data by using Pentaho Data Integrator on a file by file basis for a defined list of approx. 140 publishers, making use of the URL’s from the registry.
Is there any push to have either @andylolz’s IATI wonderful data dump, or something identical (with Andy’s permission, provided by the new datastore and therefore adopted as an official IATI product?
Please consider my permission hereby granted! Agree, it would be cool if this service could be provided officially.
Ongoing maintenance is minimal – I frequently use this service, but it hasn’t required any maintenance at all since it was created.