The Activity Standard allows for publishers to reflect their particular business model by reporting their activities in a hierarchical structure: for example using hierarchical levels to distinguish between programmes and their constituent projects and sub-components. Rules and guidance are unclear, inter alia, as to:

  • What elements must be inherited by a child activity
  • At what level commitments and budgets can be reported
  • At what level results can be reported

This also impacts upon publisher statistics methodology.

Please add other hierarchy-related issues here

This paper outline is part of the Agenda for the IATI TAG 2016 Technical Consultation Workshop

#IATI #TAG2016

Comments (24)

Tim Davies
Tim Davies

Flagging that we also identified some hierarchy related issues when considering traceability. Not sure if any of these were very substantive, so will check with Steven Flower if there is anything we should add to this.

Steven Flower
Steven Flower

Thanks Tim Davies

I think we found examples that go against the guidance held within the schema:

If multiple levels are reported then, to avoid double counting, financial transactions should only be reported at the lowest hierarchical level.

The schema does not test for this, meaning people can easily publish transaction data at multiple hierarchies.

A related issue exists if some organisations pursue publishing requirements for their supply chain (for example) as splitting various IATI elements across hierarchies could present challenges for testing and verifying data (eg: test only for element x at hierarchy y)

Wendy Rogers
Wendy Rogers

Thanks Steven Flower and Tim Davies . We are also aware that there are many publishers using hierarchies in very different ways which of course makes things very difficult for data users. As a result we are hoping to establish a definitive set of guidelines that all publishers can agree on and can use? Also we are looking at making hierarchies more usable for their original intended purpose which was to enable the earliest reporting of an organisation’s own internal funding decisions and flows.

In addition, as it may not be possible to validate the proposed guidelines via the schema and /or rulesets it may be necessary to include additional code within the Validator to check that hierarchies are being used consistently (if possible)?

Anyway, hopefully we shall be publishing the initial proposals here soon.

Steven Flower
Steven Flower

Thanks Wendy Rogers

I’d add a note of caution in terms of the written-but-not-enforced-rules. Having them operational in the online IATI validator would be useful - but we should be minded that it is perfectly possible for others to validate their data via other methods (XMLLint, for example), using just the schema, and no other rules.

Bill Anderson
Bill Anderson

Steven Flower are you saying that it is possible to use the schema to validate things such as reporting transactions at the non-lowest level?

Steven Flower
Steven Flower

Steven Flower are you saying that it is possible to use the schema to validate things such as reporting transactions at the non-lowest level?

Bill Anderson No. The “rule” for this is just written in the textual description for this attribute - not enforced by the schema via any condition. Correct?

Additionally, consider a publisher with two IATI activities:

  • Activity A at hierachy 1 - contains transactions
  • Activity B at hierarchy 2 - also contains transactions

The schema does not check other activities/files to validate the one in hand. It has no awareness that activity A should not have transactions, nor to look in activity B for them.

Consider this publisher: http://dashboard.iatistandard.org/publisher/malariaconsortium.html

This file:
http://www.malariaconsortium.org/IATI-XML/GB-CHC-1099776-J7.xml - passes validation - eg:
http://validator.iatistandard.org/?perm=www.malariaconsortium.org_IATI-XML_GB-CHC-1099776-J7.xml_1485599180

However, within that one file are activities across two hierarchies, both of which contain transactions

Wendy Rogers
Wendy Rogers

Thanks Steven Flower and the point you make about IATI Standard ‘rules and guidlelines’ is a very timely one and is another issue that we are planning to explore at the TAG see Tech Paper: Miscellaneous Rules and Guidelines

We need to be absolutely clear about what defines ‘The Standard’ eg is it more than just the Schema and rulesets? What other publishing requirements should it include? etc.

Rolf Kleef
Rolf Kleef

W’ve actually adviced organisations to use transactions at different levels of hierarchy: you may run a Programme funded by a donor (transaction for incoming commitment) and have a couple of child related-activities for specific Projects in that Programme, with commitments and disbursements to other organisations.

Exactly like Steven’s example of the Malaria Consortium sketches. And in line with the DGIS Guidelines.

  • An open question is whether transactions between a parent and child activity are needed (not always represented in the financial system that feeds into the IATI data).

  • It often is possible to “collapse” a parent and its child activities into a single activity node that has incoming and outgoing transactions.

So there indeed some questions:

  • Should there be “implicitly declared” or “default” flows along parent-child relations?
  • Should it be allowed to declare a parent-child relation across organisational boundaries?
  • What exactly does it mean to declare a hierarchical relation? We mostly see it used for the way eithr organisational processes or financial flows are structured, but you could also declare parent-child relations based on your theory of change (with more output-oriented results at lower levels, and outcome-oriented results at higher levels of the hierarchy).
Bill Anderson
Bill Anderson

Current rule is " If multiple levels are reported then, to avoid double counting, financial transactions should only be reported at the lowest hierarchical level."

I think we have consensus on the need for a change so that commitments and incoming funds can be reported at any level. (And ditto for budgets.)

The outstanding issue is disbursements and expenditures. Steven Flower I don’t see examples of this in your Malaria Consortium case. Have I missed it?

Image removed. rolfkleef:

Should there be “implicitly declared” or “default” flows along parent-child relations?

Yes, I think so.[quote=“rolfkleef, post:9, topic:539”]
Should it be allowed to declare a parent-child relation across organisational boundaries?
[/quote]

No. I think this could create havoc. Relationships between organisations are expressed through money or role. Isn’t this sufficient?[quote=“rolfkleef, post:9, topic:539”]
What exactly does it mean to declare a hierarchical relation?
[/quote]

It is the representation of an organisation’s business model in circumstances where NOT representing it makes it difficult for an organisation to accurately describe its activities.

I think we should strengthen our guidance that hierarchies add complexities for users and should only be used when a business model can’t be otherwise described.

Steven Flower
Steven Flower

Really interesting, thanks Rolf Kleef

To just expand on:

It often is possible to “collapse” a parent and its child activities into a single activity node that has incoming and outgoing transactions.

We’ve been looking at this with John Adams and DFID, in terms the use case of “fund managers” publishing information about their link in the chain.

In one example the fund manager takes a nested approach - publishing incoming funds into a central activity, and then disbursing through to hierarchy 2 activities that then disburse out to the implementing orgs. This seems to place an overhead on both the publisher and data user, and we’re not sure of the benefit

Hence, I pulled this slidedeck together to propose a “flat model”, making it less complex to deal with. A trade off could be less detail, but it seems to pay on maintaining utility of the data, versus completeness.

Arguably, the above does not have much direct relation to hierarchies, as we remove them in the flat model. Our core focus is on getting to a point where data can be well-maintained, leading to ease-of-use.

Wendy Rogers
Wendy Rogers

Thanks Steven Flower and I just wanted to add that the primary benefit of using hierarchies for the management of funds that are received by an organisation into a central ‘pot’ before being subsequently disbursed to other funds / projects/ contracts etc. is that it enables the publisher to publish information about funding decisions as near to real time as they are made within the organisation. It can be many months or even years before some funds are actually disbursed to another external organisation so using hierarchies can facilitate the transparency of the funding as it is moved through the organisation over time.

Rolf Kleef
Rolf Kleef

The hierarchy of activities is usually how an organisation already structures the data in their own systems, so it’s actually not that difficult or error-prone to produce IATI data that reflects this.

It improves transparency of how organisations operate (in some of our workshops this leads to discussions about ways of managing your work).

The difficulty is in the transactions from parent to child: there usually are commitments, but an equivalent of a disbursement may be missing. (Hence my question about implicit flows in such structures.)

Bill Anderson
Bill Anderson

Current rule is " If multiple levels are reported then, to avoid double counting, financial transactions should only be reported at the lowest hierarchical level."

I think we have consensus on the need for a change so that commitments and incoming funds can be reported at any level. (And ditto for budgets.)

The outstanding issue is disbursements and expenditures. Steven Flower I don’t see examples of this in your Malaria Consortium case. Have I missed it?

Image removed. rolfkleef:

Should there be “implicitly declared” or “default” flows along parent-child relations?

Yes, I think so.[quote=“rolfkleef, post:9, topic:539”]
Should it be allowed to declare a parent-child relation across organisational boundaries?
[/quote]

No. I think this could create havoc. Relationships between organisations are expressed through money or role. Isn’t this sufficient?[quote=“rolfkleef, post:9, topic:539”]
What exactly does it mean to declare a hierarchical relation?
[/quote]

It is the representation of an organisation’s business model in circumstances where NOT representing it makes it difficult for an organisation to accurately describe its activities.

I think we should strengthen our guidance that hierarchies add complexities for users and should only be used when a business model can’t be otherwise described.

Bill Anderson
Bill Anderson

Our draft paper, is now available here

Feel free to add comments to the document or to continue the discussion in this thread. I will take on an editorial role and combine all comments and suggestions into a coherent document as we go along.

Please note that we have had a further rethink as a result of this thread and are now proposing that any transaction can occur at any hierarchical level provided that there is no double counting within the hierarchical group as a whole.

Bill Anderson
Bill Anderson

I have tidied up the proposals in the draft paper in the light of Rolf Kleef ’s comments.

On the question of removing hierarchies altogether - which as John Adams comments could arguably simplify the use of data:

  • If we had to start building the standard from scratch again I would definitely be in favour of a ‘flat’ approach which used a simpler way to express publisher business models and relationships between activities.
  • However 50 publishers are using hierarchies. We can’t - other than through an integer upgrade - force them to change the way they publish.
  • There could be a slow pragmatic solution to this whereby: publishers are persuaded to voluntarily stop using hierarchies; guidelines encourage publishers not to use them; and the attribute is deprecated once no longer used by anyone.
Herman van Loon
Herman van Loon

Bill Anderson Yes, I think this rule will clarify the handling of fund hierarchies.

I am not sure about the rule “provided that there is no double counting within the hierarchical group as a whole.” It might be interesting information to track the outgoing flows from hierarchy level 1 to hierarchy level 2. E.g. when want to answer questions as “How much is programmed by the fund manager (=actually allocated to specific implementing organizations) but is not yet disbursed to the implementing organizations.”.

So the double counting should i.m.o. be dealt with at the moment of presentation and not on the moment of publishing the data. How you deal with it is depending on your use-case. I agree with Mark Brough that the IATI consuming tools should take care of this. The data need i.m.o. to represent the real world business process as close as possible?

Rolf Kleef
Rolf Kleef

Thanks! I’ve added some comments (request for clarification).

Bill Anderson I tend to agree with you on the first two questions:

  • Implicit transactions (as in the document) make sense to me.
  • Adding cross-organisational parent-child links may make representing a partnership contract with one lead organisation easier, but in the current way, a lot of other things a lot harder.

For the third, I would promote rather than restrain the use of hierarchies to stay closer to existing information models.

But there is the question of “multiple hierarchies” (rather than “multiple levels of one hierarchy”). This comes up with reporting results: how can you report multiple results and indicators, and have them organised in multiple hierarchies that are cross-organisational (in partnerships) and/or in-organisation hierarchies?

Bill Anderson
Bill Anderson
Image removed. rolfkleef:

But there is the question of “multiple hierarchies” (rather than “multiple levels of one hierarchy”). This comes up with reporting results: how can you report multiple results and indicators, and have them organised in multiple hierarchies that are cross-organisational (in partnerships) and/or in-organisation hierarchies?

This one hurts my head. The only answer I can suggest is “with extreme prejudice”.

Is this a serious use case?

Steven Flower
Steven Flower

Sorry Bill Anderson , I missed your comment:

Steven Flower I don’t see examples of this in your Malaria Consortium case. Have I missed it?

This example file validates to the schema, but has activities across different hierarchies, that have the transaction element. I was not looking for any mix or range of different transaction types, as the standard guidance does not declare any distinction:

If multiple levels are reported then, to avoid double counting, financial transactions should only be reported at the lowest hierarchical level.

Rolf Kleef
Rolf Kleef

In our work with results frameworks in partnerships, we precisely run into the problem that there is no way to express related-result/indicator relations.

Sometimes the indicator logic “follows the money”, but an activity with co-funding may serve two different donor results frameworks, or even a third if you have an organisational results framework as well. These frameworks may or may not overlap.

We can show results from the data, but in order to present that in a hierarchy other than through the activity structure, we need separate non-IATI data. People start circulating spreadsheets with indicator names and id’s within a partnership.

It would be easier to show people “what’s in the data” if result hierarchies can be deduced from the data as well. Doing that leads to discussions about possible further standardisation within and across organisations.

Bill Anderson
Bill Anderson
Image removed. rolfkleef:

but an activity with co-funding may serve two different donor results frameworks

  • Would it help if there was something that allowed you to relate an indicator to a donor framework so that for a single activity two similar (but not identical) indicators could be linked to the donor requirements.
  • Would it also help to be able to indicate in Activity A that results reported in Activity B (irrespective of publisher) also apply to activity A?
Image removed. rolfkleef:

result hierarchies can be deduced from the data as well

You’ve still lost me on this one

Mark Brough
Mark Brough

Interesting discussion! I added a few comments in the document in defence of hierarchies

Basically, I think they are very useful for interpreting / understanding the data. In the Bangladesh work we’ve used them quite a lot. On the publisher side, I think they also allow data to be accurately expressed while also making it possible to publish more detailed data by publishing subcomponents of larger programs.

At the same time, we definitely need better advice on ways of handling hierarchies from the user perspective. It would also be good if some of the major tools that exist for exploring the data (particularly d-portal) handled this better.

John Adams
John Adams

The current usage of hierarchies across 500+ publishers is as follows:
43 publishers are currently using 2 levels of hierarchies
6 publishers are currently using 3 hierarchies
2 publishers are using the highest number of 4 hierarchies

Do we know who are the 6 and 2 using >2 hierarchies?


Please log in or sign up to comment.