Data gaps in aid impact must be filled, urges review

Copyright: Flickr/DFID

By: Andrew Williams

We encourage you to republish this article online and in print, it’s free under our creative commons attribution license, but please follow some simple guidelines:

You have to credit our authors.
You have to credit SciDev.Net — where possible include our logo with a link back to the original article.
You can simply run the first few lines of the article and then add: “Read the full article on SciDev.Net” containing a link back to the original article.
If you want to also take images published in this story you will need to confirm with the original source if you're licensed to use them.
The easiest way to get the article on your site is to embed the code below.

For more information view our media page and republishing guidelines.

The full article is available here as HTML.

Press Ctrl-C to copy

<div class="article-wrap">
<div id="article-introduction">
<h1>Data gaps in aid impact must be filled, urges review</h1>
<h4>By: Andrew Williams</h4>
</div>
<br />
<br />

<div id="article-body">
<p>
	<span>"Major gaps" in the evidence base relating to the impact of development aid on efforts to meet the UN <a href="http://www.scidev.net/en/science-and-innovation-policy/mdgs/">Millennium Development Goal (MDG)</a> on maternal and reproductive <a href="http://www.scidev.net/en/health/">health</a> outcomes (MDG 5) need to be addressed to ensure that aid's true impact can be measured, according to a study.</p>
<p>	In the first ever such exercise, researchers systematically reviewed studies across 27 countries on aid-funded interventions designed to improve maternal and reproductive health, in an effort to summarise the evidence of the impact of official development aid on MDG 5 outcomes. </span></p>
<p>
	Even with a "generous application" of the MDG definitions, which led to the inclusion of studies that used proxy measures for some of the individual indicators within the goal, the review found "discernible" gaps in the evidence base on aid interventions targeting MDG 5.</p>
<p>	The most notable related to indicators MDG 5.4 (adolescent birth rate) and 5.6 (unmet need for family planning). Of the 30 studies reviewed, only three provided any evidence relating to these indicators.</p>
<p>	In the light of such gaps, the authors call for rigorous, independent and peer-reviewed studies that attempt to make a "plausible association" between the mode of aid delivery and MDG 5-related health outcomes, and that provide greater detail about aid interventions and outcome data.</p>
<p>	"I suppose it's the first such evaluation [of its type] because the development sector is only now turning to what might be termed more rigorous evidence-based methodologies, drawing heavily from public health policymaking," principal investigator James Smith, professor of African and development studies at the University of Edinburgh, United Kingdom, tells <em>SciDev.Net</em>.</p>
<p>	Rachel Hayman, head of research at the International NGO Training and Research Centre, Oxford, United Kingdom, and a co-author of the study, says: "In the last two years, there has been a huge debate in the sector about evidence, leading to a definite trend among donors and the larger NGOs, for example, to tighten up their systems for gathering data on their projects and activities."</p>
<p>	The research team are hopeful that their conclusions will inform the process of setting up and evaluating the Sustainable Development Goals that are set to replace the MDGs in 2015.</p>
<p>	Hayman says she hopes the review shows how the management of information on development interventions can be improved.</p>
<p>	"We need to promote not just more rigorous [monitoring and evaluation] but also 'appropriate' M&E and evidence-based research," she says.</p>
<p>	Timothy Powell-Jackson, a lecturer in health economics at the London School of Hygiene & Tropical Medicine, United Kingdom, says the study shows that the development aid research community needs to invest more in data systems and rigorous evaluation.</p>
<p>	"The research agenda should focus on understanding what works and why. The impact of aid or the contribution of a particular donor is less relevant in my view. The best research addresses questions of policy relevance, draws on sound theory and uses rigorous research designs," he says.</p>
<p>	The study was published in <em>PLOS ONE</em> last month (22 February).</p>
<p>	<a href="http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0056271">Link to the study</a></p>

</div>
<div class="quick-links-wrapper">
<h3>You might also like</h3>
[related-articles]
</div>
<p>This article was originally published on <a href="https://www.scidev.net" target="_blank">SciDev.Net</a>. Read the <a href="https://www.scidev.net/global/news/data-gaps-in-aid-impact-must-be-filled-urges-review-4/" target="_blank">original article</a>.</p>
<script type="text/javascript">
(function(e,t,n,r,i,s,o){e["GoogleAnalyticsObject"]=i;e[i]=e[i]||function(){(e[i].q=e[i].q||[]).push(arguments)},e[i].l=1*new Date;s=t.createElement(n),o=t.getElementsByTagName(n)[0];s.async=1;s.src=r;o.parentNode.insertBefore(s,o)})(window,document,"script","//www.google-analytics.com/ga.js","ga");var _gaq=_gaq||[];var _gaq=_gaq||[];_gaq.push(["_setAccount","UA-3223906-8"],["_trackEvent","article interaction","republished","https://www.scidev.net/global/news/data-gaps-in-aid-impact-must-be-filled-urges-review-4/",null,true])
</script>
</div>

"Major gaps" in the evidence base relating to the impact of development aid on efforts to meet the UN Millennium Development Goal (MDG) on maternal and reproductive health outcomes (MDG 5) need to be addressed to ensure that aid's true impact can be measured, according to a study.

In the first ever such exercise, researchers systematically reviewed studies across 27 countries on aid-funded interventions designed to improve maternal and reproductive health, in an effort to summarise the evidence of the impact of official development aid on MDG 5 outcomes.

Even with a "generous application" of the MDG definitions, which led to the inclusion of studies that used proxy measures for some of the individual indicators within the goal, the review found "discernible" gaps in the evidence base on aid interventions targeting MDG 5.

The most notable related to indicators MDG 5.4 (adolescent birth rate) and 5.6 (unmet need for family planning). Of the 30 studies reviewed, only three provided any evidence relating to these indicators.

In the light of such gaps, the authors call for rigorous, independent and peer-reviewed studies that attempt to make a "plausible association" between the mode of aid delivery and MDG 5-related health outcomes, and that provide greater detail about aid interventions and outcome data.

"I suppose it's the first such evaluation [of its type] because the development sector is only now turning to what might be termed more rigorous evidence-based methodologies, drawing heavily from public health policymaking," principal investigator James Smith, professor of African and development studies at the University of Edinburgh, United Kingdom, tells SciDev.Net.

Rachel Hayman, head of research at the International NGO Training and Research Centre, Oxford, United Kingdom, and a co-author of the study, says: "In the last two years, there has been a huge debate in the sector about evidence, leading to a definite trend among donors and the larger NGOs, for example, to tighten up their systems for gathering data on their projects and activities."

The research team are hopeful that their conclusions will inform the process of setting up and evaluating the Sustainable Development Goals that are set to replace the MDGs in 2015.

Hayman says she hopes the review shows how the management of information on development interventions can be improved.

"We need to promote not just more rigorous [monitoring and evaluation] but also 'appropriate' M&E and evidence-based research," she says.

Timothy Powell-Jackson, a lecturer in health economics at the London School of Hygiene & Tropical Medicine, United Kingdom, says the study shows that the development aid research community needs to invest more in data systems and rigorous evaluation.

"The research agenda should focus on understanding what works and why. The impact of aid or the contribution of a particular donor is less relevant in my view. The best research addresses questions of policy relevance, draws on sound theory and uses rigorous research designs," he says.

The study was published in PLOS ONE last month (22 February).

Link to the study