How can we trust IATI data?


(Steven Flower) #1

(or, how can the computers trust the data?)

We know from the “Use of IATI in Country Systems” paper (written by @Joshua_Powell and team) and from user research around the Initiative for Open Ag Funding (myself, @laia_grino & @TimDavies) that access to information about the production, upkeep and conditions of any IATI data file are key aspects to building trust, which then play a key part in any decision for people to use it.

Currently, it seems that this “metadata” is recorded in two possible places:

  • The publisher Implementation Schedule (IS). This is usually a spreadsheet. It’s not published by all.
  • The “About” section for a publisher on the IATI Registry. This mirrors some of the fields in the IS, but not all. It is only available (I think) as a web page.

It could be argued that these two documents are enough, when viewed alongside the “last updated” data points for files, for people to understand and evaluate datasets, before accessing them. Granted, it could also be possible to access the IATI Dashboard to evaluate data - and perhaps there is chance to build more services around this.

However, a brief tour of the forms on the IATI Registry can illustrate that these are quite often “blank”: here and here (picked at random). Additionally, we have no information as to when this data was last updated, etc. It also seems the formats of this information is less “standardised” and “machine readable”, which is curious, considering the focus of IATI.

I therefore wanted to ask if others in the community have any interest to support greater production and access to “data on the data”, which might make for an interesting TAG discussion.

With this in mind, there could be two related topics:

  • What purpose does the IATI Registry Record Schema serve in all this? It’s been around since the very start of IATI, but not often utilised.
  • Services such as the ODI Certificates have gained traction recently, in terms of methods to record such information - are they useful to the IATI community?

Fundamentally, we may need to close the gap between the timeliness and comprehensiveness of the information recorded about IATI data, so that data users can easily and effectively process it for their needs.