15 April 2011 | EN | ES
The real value of open access journals goes beyond citation rates
Focusing on the 'citation advantage' of open access misses its value in getting science information in the hands of those who need it.
Ever since the open access (OA) movement was launched in the 1990s, support in the scientific community for the principle OA represents — that all scientific publications should be made freely available, at least in electronic form — has outstripped individual scientists' willingness to put that principle into practice.
The most important reason, according to a recent study commissioned by the European Union, is money. Publishers of OA journals, deprived of income from subscribers, require fees from authors to cover publication costs. Although many funding agencies now provide for these fees in their research grants, not all do — and authors' fees are a particular obstacle for scientists in developing countries.
The study found that a second important disincentive to publishing in OA journals is that most scientists still prefer, where possible, to publish in established journals with high citation rates — a proxy for quality of scientific publications when it comes to promotion, for example, or measuring how a scientist has contributed to their institution's reputation.
Many such journals, including some of the most prestigious, are owned by commercial publishers with little incentive to give away access to their content for free.
Citation rates are still the 'gold standard' for evaluating the quality of research, and many scientists say there are too few highly cited, or high quality, OA journals in their field. That is despite some of the better known OA journals, such as those published by the Public Library of Science (PLoS), taking steps to ensure high scientific standards.
The overall result — according to calculations by Stevan Harnad, one of the closest observers of the OA movement — is that even by 2020, only about one quarter of scientific articles will be freely accessible.
'Citation advantage' questioned
A study published last month by Philip Davis, of Cornell University in the United States, has been widely interpreted as throwing OA into further doubt, by questioning what is generally perceived as a major benefit of OA publishing — the 'OA citation advantage'.
Some publishers claim that publishing in an OA journal is itself sufficient to increase the number of times an article is cited, purely because it will become more widely available within the scientific community.
Davis' new research, an analysis of articles published in 36 journals over three years, concluded that free access articles were no more likely, or less likely, to be cited by other researchers than those appearing in conventional journals.
Is this a fatal flaw in the arguments for supporting OA, as the press release announcing the conclusions appears to suggest?
Far from it. The debate these results has triggered sidesteps consideration of the full value of OA journals.
This lies not merely in how they benefit science specialists, but also in making scientific research widely available to those who can neither afford high subscription rates for specialist journals, nor get access to scientific libraries — but whose work or personal interest depend on having access to the global pool of scientific knowledge.
Those who benefit from OA include many scientists in the developing world, where most university and research institution libraries remain heavily underfunded.
Then there are students, who are equally keen to follow new scientific developments. And finally there are all those who put scientific research to practical use — including members of the public, as well as professional groups such as healthcare workers.
As Davis has said, "there are many benefits to the free access of scientific information" — a point long argued by OA advocates, even if a citation advantage may not prove to be one of them.
Leslie Chan, and his colleagues at the Electronic Publishing Trust, expressed similar sentiments in a recent article in PLOS Medicine, where they argue that "the sharing of knowledge discovery across borders and the building of a global knowledge commons is increasingly important for solving problems that we all face".
Measuring real value
Putting this social value of science into measurable terms is much more difficult that the relatively simple calculations of citation rates. It is a big challenge — and one reason why citations continue to play such a dominant role in assessing individual scientists' or their institutions' achievements.
And as Chan et al. point out, standards for assessing journal quality and relevance are generally based on "Northern" values that often ignore development needs and marginalise local scholarship.
Until we can find robust ways to measure the success of integrating development goals into the research programmes of developing countries, and of how local scientists contribute to achieving these, the potential of OA is unlikely to be fully recognised.
Even if the evidence for a citation advantage is as weak as Davis' research suggests, this does not undermine the case for OA publishing — or even for the less ambitious route to free access represented by creating Open Repositories (so-called 'green OA') controlled by scientists themselves and their institutions.
What the evidence does do is reinforce the folly of using citation rates alone as the main measure of the social value of science and the work of scientists.
Farooq ( Pakistan )
16 April 2011
Thank you for a very informative and interesting write up. You are absolutely correct in pointing out that advantage of open access goes beyond the commonly quoted "citation advantage"
The actual benefit is to researchers like me from developing countries who don't have institutional access to the data bases or money to buy a single article for 30-50 US dollars.
Open access has revolutionized the scientific publications and its time that big names in publishing should take it seriously and promote it.
Derek Law ( University of Strathclyde | United Kingdom )
18 April 2011
Last year I spent two months teaching in Malawi as a Scotland-Malawi Fellow. I returned more convinced than ever of the power of information to change lives - and quite literally extend them. Open Access is a keystone for making change
Professor Derek Law
Stevan Harnad ( Université du Québec à Montréal | Canada )
19 April 2011
Downloads of research are important and evidence of the open-access (OA) download advantage is growing:
Hitchcock (2011) "The effect of open access and downloads ('hits') on citation impact: a bibliography of studies"
Swan (2010) "The Open Access citation advantage: Studies and results to date"
Wagner (2010) "Open Access Citation Advantage: An Annotated Bibliography"
But the OA citation advantage is especially important because research is published to be accessed, used, applied and built upon in further research: Research is done by researchers, for uptake by researchers, for the benefit of the public that funds the research. Both research progress and researchers' careers and funding depend on research uptake and impact.
OA's greatest growth potential today is self-archiving mandates by institutions and funders (e.g., Harvard, MIT) . See ROARMAP.
Universities adopt OA mandates to maximize their research impact. The large body of evidence, in field after field, that OA increases citation impact, helps motivate universities to mandate OA self-archiving of their research output, to make it accessible to all its potential users rather than just those whose universities can afford subscription access, so that all can apply, build upon and cite it. (Universities can only afford subscriptions to a fraction of research journals.)
The Davis study lacks the statistical power to show that the open access citation advantage is not causal, but merely an artifact of authors self-selectively self-archiving their better (hence more citable) papers. Davis's sample size was smaller than many of the studies reporting the open access citation advantage. Davis found no citation advantage for randomized open access. But that does not demonstrate that open access is a self-selection artifact -- in that study or any other study -- because Davis did not replicate the widely reported self-archiving advantage either, and that advantage is often based on far larger samples.
Peter Ballantyne, ILRI ( ILRI | Ethiopia )
20 April 2011
Thanks David for this piece.
One of the problems we face to promote more open access is the convenient existence of the impact factor that researchers and their funders can use.
I think we need some other equally robust (?) factor that we can use to show the accessibility of our research outputs. Appearing in journals with 'high' impact factors is of course attractive for scientists and their institutions - who are measured on this. Can someone perhaps come up with an alternative measure - beyond citations - that would show the wider social value or public good of different publishing channels.
I suspect some of the 'high' impact journals might score much lower on some kind of accessibility factor.
Stevan Harnad ( Université du Québec à Montréal | Canada )
27 June 2011
OPEN ACCESS: NOT JUST ABOUT CITATIONS
I forgot to mention that David's piece is again focussed on (Gold) OA publishing, as if that were the sole or principal way of providing OA.
It is not. Authors can provide (Green) OA by posting the final drafts of their articles online, free for all, immediately upon acceptance for publication.
That does not require publishing elsewhere than in your journal of choice. It does not require paying an extra fee. And all it can do is increase your citations, since you get the ones you would have gotten from subscribers anyway. The studies on the (Green) OA citation advantage compare citations in the same journal and year, for articles that are and are not made Green OA.
All SciDev.Net material is free to reproduce providing that the source and author are appropriately credited. For further details see Creative Commons.