Select Page

Expanding from earlier initiatives like the San Francisco Declaration on Research Assessment (DORA) or the Leiden Manifesto, CoARA widens its scope beyond a simple statement of purpose. It actively encourages organizations to pledge their commitment to overhaul their assessment methods within a defined time frame, spanning from 2022 to 2027.

The Centre de Recerca Matemàtica (CRM) has officially signed the Agreement on Reforming Research Assessment joining the Coalition for Advancing Research Assessment (CoARA). CoARA is a global coalition that unites a diverse array of institutions engaged in research evaluation, along with their respective associations, committed to reimagining and reforming the landscape of research evaluation. This alliance, first launched in December 2022, involves research funding bodies, universities, research institutions, and national and regional assessment agencies. All these entities are motivated to cooperate, striving for a transformative overhaul grounded in shared principles and commitments outlined in the Agreement.

Research assessment has long been a hotbed of debate within the academic community, with traditional metrics such as journal impact factors and citation count often falling short of capturing the full spectrum of research quality. The agreement, structured around ten core commitments, suggests acknowledging the wide array of practices, activities, and professional paths within the realm of research. It also advocates for the incorporation of qualitative benchmarks to reduce the reliance on metrics tied to journals and publications.

Furthermore, the agreement calls for the allocation of ample resources for research assessment, along with the examination and enhancement of novel evaluation criteria and procedures. This new approach also places an emphasis on qualitative indicators and metrics, ensuring that the evaluation process is sensitive to the broader societal context in which research operates.

The organizations that have endorsed the CoARA agreement aim to revise and enhance the standards, tools, and procedures used to assess scientific endeavours, while also increasing awareness of and providing training to their staff on this reform initiative. Members of the coalition are committed to sharing their best practices and experiences to facilitate mutual learning, keeping each other informed about their progress in adhering to the principles and fulfilling their commitments, and conducting evaluations of assessment practices and criteria based on robust evidence related to research evaluation.

A common path towards advancing assessment methods for research.

In the pursuit of fair and responsible research assessment, the CoARA agreement commits to recognizing the diversity of research contributions and careers, aligning them with research needs. Among other aspects, the core principles of the agreement recommend assessment primarily relying on qualitative peer reviews, complemented by responsible quantitative indicators. CoARA also encourages leaving behind inappropriate metrics like the Journal Impact Factor and rankings of research organizations, and pledges to allocate resources for the necessary changes in research assessment. Processes should also be reviewed and refined, and transparent communication and guidance should be promoted to raise awareness and provide training.

According to Lluís Alsedà, who serves as the Director of the Centre de Recerca Matemàtica (CRM) and holds the position of professor at the Universitat Autònoma de Barcelona (UAB), he takes a stance against the JCR index with the following three assertions:

“For years, we’ve been assessing things wrongly. Since the introduction of the JCR index[1], evaluations of both research articles and personnel have been conducted using erroneous criteria. Nevertheless, it’s noteworthy that the institutions of the Spanish State have endorsed the San Francisco Declaration. This demonstrates the willingness to conduct evaluations from a more ethical standpoint, acknowledging the diverse groups involved in research and the varying intensities of research activities. The problem we have now is that we don’t know the rules of the game […] In response to this issue, the Consortium of Academic and Research Assessment (CoARA) has emerged as an entity dedicated to assisting researchers in expressing their opinions. Their goal is to establish a foundation for more ethical and sustainable evaluation methods within the realm of daily research.”

Through active involvement in this united and cooperative endeavour, the Centre de Recerca Matemàtica wholeheartedly dedicates itself to enhancing the assessment of research. The objective is evident: to integrate the instruments established within this alliance, ultimately attaining superior research outcomes of noteworthy influence, all the while upholding equity and openness.

Through this commitment, the CRM will play a part in building a more efficient, inclusive, and advantageous research environment for everyone, paving the way for more meaningful assessments that align with the dynamic needs of the scientific community.

The 10 commitments of the CoARA Agreement

    1. Recognize the diversity of contributions to, and careers in, research in accordance with the needs and nature of the research.
    2. Base research assessment primarily on qualitative evaluation for which peer review is central, supported by responsible use of quantitative indicators.
    3. Abandon inappropriate uses in research assessment of journal and publication-based metrics, in particular inappropriate uses of Journal Impact Factor (JIF) and h-index.
    4. Avoid the use of rankings from research organizations in research assessment.
    5. Commit resources to reform research assessment as needed to achieve the organizational changes committed to.
    6. Review and develop research assessment criteria, tools, and processes.
    7. Raise awareness of research assessment reform and provide transparent communication, guidance, and training on assessment criteria and processes as well as their use.
    8. Exchange practices and experiences to enable mutual learning within and beyond the Coalition.
    9. Communicate progress made on adherence to the principles and implementation of the Commitments.
    10. Evaluate practices, criteria, and tools based on solid evidence and state-of-the-art in research on research and make data openly available for evidence gathering and research.

For further information about the Coalition, see the CoARA website.

[1] JCR (Journal Citation Report) is a relative quality index (ICR) metric used to assess the scientific quality of academic journals provided by Thomson Reuters. It is determined by dividing the number of citations a journal received in a given year for the two preceding years by the total number of articles published by the journal during those two cited years.

 

CRM Comm

CRM Comm

Pau Varela & Mariona Fucho

CRMComm@crm.cat

Subscribe for more CRM News

Stay updated to our mailing list to get the lastest information about CRM activities.

The CRM participates in the MSCA-COFUND TOUCH Project

The CRM participates in the MSCA-COFUND TOUCH Project

The CRM participates in the MSCA-COFUND TOUCH Project The MSCA-COFUND TOUCH project, spearheaded by the Universitat Autònoma de Barcelona (UAB), has been funded under the prestigious Marie Skłodowska-Curie Actions (MSCA) and the Horizon Europe...

Exploring Career Pathways for Mathematics Graduates: Insights from the ‘And after the Degree, What?’ Roundtable

Exploring Career Pathways for Mathematics Graduates: Insights from the ‘And after the Degree, What?’ Roundtable

The roundtable titled “And after the Degree, What?” held at the Universidad de La Rioja, during the Conference of Deans of Mathematics, explored various career options for mathematics graduates, such as academia and industry. David Romero, head of the Knowledge Transfer Unit (KTU) at CRM, discussed the unique aspects of industrial PhDs, emphasizing their value in producing highly qualified professionals.

Participació del CRM a l’EspaiCiència

Participació del CRM a l’EspaiCiència

El passat 13 de març, Andrea Suárez, Fernando Gastón i Marcel Morillas, de la Unitat de Transferència del Coneixement del CRM (KTU), juntament amb Pau Varela i Mariona Fucho, de comunicació i divulgació, van participar a l’EspaiCiència dins del...

El matemàtic francès Michel Talagrand guardonat amb el premi Abel 2024

El matemàtic francès Michel Talagrand guardonat amb el premi Abel 2024

El Premi Abel 2024 ha estat atorgat a Michel Talagrand, matemàtic del Centre Nacional de la Recerca Científica (CNRS) a París, França. Talagrand ha desenvolupat la seva recerca en la teoria de probabilitats i l’anàlisi funcional, disciplines que investiguen el comportament dels processos aleatoris i les propietats dels espais i funcions. El Premi Abel, sovint comparat amb el Premi Nobel de matemàtiques, va ser establert pel govern noruec el 2002 per honorar el 200è aniversari del naixement de Niels Henrik Abel, un matemàtic noruec.

Estudiants de l’Institut La Vall del Tenes de Barcelona visiten el CRM

Estudiants de l’Institut La Vall del Tenes de Barcelona visiten el CRM

Més de cinquanta estudiants de l’Institut La Vall del Tenes de Barcelona van visitar el Centre de Recerca Matemàtica (CRM) el 21 de març, com a part de la seva participació en les proves Cangur. Durant la visita, els estudiants van poder conèixer de primera mà el món de la recerca científica a través de tres investigadors predoctorals del CRM, que van compartir els seus coneixements i experiències en camps tan diversos com la biologia matemàtica, neurociència i sistemes dinàmics.

El CRM participa en l’Exporecerca Jove donant un premi especial

El CRM participa en l’Exporecerca Jove donant un premi especial

El CRM va participar a l’edició de l’Exporecerca Jove celebrada del 6 al 9 de març, on va atorgar un premi especial al millor treball de matemàtiques o de contingut matemàtic. L’Exporecerca Jove és una fira de recerca internacional per a estudiants de secundària i batxillerat. Els projectes són avaluats per un jurat qualificat.