The Coalition for Advancing Research Assessment (CoARA) is a new organization that has sparked a vigorous debate on the use of peer review and evaluative metrics in research assessment. This debate has been ongoing for years, but the formation of CoARA brings a fresh perspective and a renewed commitment to finding a balance between these two methods of evaluating research.
The CoARA Steering Board, along with Luciana Balboa, Elizabeth Gadd, Eva Mendez, Janne Pölönen, Karen Stroobants, and Erzsebet Toth Cithra, have come together to address the arguments surrounding research assessment, scientometrics, and the use of qualitative versus quantitative measures. Their goal is to promote responsible and effective use of both peer review and bibliometrics in research assessment.
In recent years, there has been a growing trend towards the use of bibliometric indicators, such as citation counts and publication metrics, in assessing the quality and impact of research. These quantitative measures have gained popularity due to their efficiency and objectivity, but they have also faced criticism for oversimplifying the complex nature of research and potentially marginalizing certain disciplines or types of research.
On the other hand, peer review, which involves the evaluation of research by experts in the field, has long been regarded as the gold standard for assessing the quality and impact of research. It allows for a more nuanced and comprehensive evaluation of research, taking into account factors such as originality, significance, and methodology. However, the peer review process is not without its flaws and can be time-consuming and subject to bias.
The debate between these two methods of research assessment has been ongoing for many years, with each side arguing for their merits and pointing out the flaws of the other. But the formation of CoARA signifies a shift towards finding a balance and utilizing both methods in a responsible and effective way.
The CoARA Steering Board and its members firmly believe that there is no one-size-fits-all solution when it comes to research assessment. Each discipline, research topic, and individual research project is unique and requires a tailored approach. This is why CoARA promotes the use of a combination of peer review and bibliometrics, rather than relying solely on one method.
They recognize that both peer review and bibliometrics have their strengths and limitations, and by using them together, the strengths of one method can complement the weaknesses of the other. This approach can lead to a more comprehensive and accurate evaluation of research that takes into account its complexity and diversity.
Moreover, CoARA is committed to promoting responsible use of both methods. This includes advocating for transparent and ethical use of bibliometric indicators, ensuring that they are used as tools to support and not replace peer review. They also emphasize the importance of using peer review in a fair and unbiased manner, eliminating potential biases based on factors such as gender, age, or institutional affiliations.
The use of both peer review and bibliometrics can also lead to a more inclusive research assessment. As mentioned earlier, the reliance on bibliometric indicators alone can result in the marginalization of certain disciplines or types of research. By incorporating peer review, a more diverse range of research can be evaluated and recognized for its quality and impact.
CoARA also recognizes the importance of considering different perspectives and involving all stakeholders, including researchers, funders, and policy-makers, in the discussions on research assessment. By bringing together a diverse group of experts and stakeholders, they aim to create a more holistic approach to research assessment and promote a culture of responsible and inclusive evaluation.
In conclusion, the creation of the Coalition for Advancing Research Assessment is a positive step towards finding a balance between peer review and evaluative metrics in research assessment regimes. Through their commitment to responsible use and inclusive evaluation, CoARA aims to create a more comprehensive and fair system that accurately reflects the quality and impact of research. We are hopeful that this initiative will bring about positive changes in the research community and pave the way for a more effective and responsible approach to research assessment.
