Research Evaluation

Informatics Europe supports Informatics research by promoting quality standards and best practices across diverse areas in the field.

In 2008, Informatics Europe published the "Research Evaluation for Computer Science" report. The report was a pioneering effort to establish best practices for the evaluation of researchers in Europe. Building on the CRA’s work in the US, the report became a key reference for Informatics departments and colleagues across Europe and was later featured in Communications of the ACM.

Over the past decade, research evaluation has evolved significantly: pressure for using quantitative measures got even stronger, open-source publications and archives have been established, new solutions have appeared around the debate on conferences vs. journals, new conference rankings are available, artifact evaluation is rising, transfer to industry and society is more and more encouraged, and the use of indexes and bibliometrics has become even stronger. In response, Informatics Europe launched a working group in 2016 to reassess these developments, leading to an updated set of recommendations in 2018.

The second revision of the final report on "Informatics Research Evaluation" was released in March 2025, addressing ongoing challenges and emerging trends. 

More about our achievements and other contributions to research evaluation in Informatics can be found under the tab “Resources”.

• Task Forces
• Outcomes
• Resources

• 2024-2025 - "Informatics Research Evaluation" Report: Second Revision

  • Pekka Orponen, Aalto University (Chair)
  • Carlos Baquero-Moreno, University of Porto
  • Manuel Carro, Technical University of Madrid / IMDEA Software Institute 
  • Michael Goedicke, University of Duisburg-Essen
  • Martin Hitz, Alpen-Adria-Universität Klagenfurt
  • Pierre Paradinas, SIF - Société Informatique de France
  • Silvio Peroni, GRIN - Associazione Italiana dei Docenti Universitari di Informatica
  • Heri Ramampiaro, NTNU
  • Ernest Teniente, SCIE / Universitat Politècnica de Catalunya
  • Heike Trautmann, University of Paderborn

  2017-2018 - "Informatics Research Evaluation" Report

  • Floriana Esposito, University of Bari (Chair)
  • Carlo Ghezzi, Politecnico di Milano
  • Manuel Hermenegildo, IMDEA Software Institute, Technical University of Madrid
  • Hélène Kirchner, Inria
  • Luke Ong, University of Oxford

  2008-2009 - "Research Evaluation for Computer Science" Report

  • Bertrand Meyer, ETH Zurich (Chair)
  • Christine Choppy, University of Paris 13
  • Jørgen Staunstrup, IT University of Copenhagen
  • Jan van Leeuwen, University of Utrecht

  *Note that the affiliation indicated was the one at the time of their participation in the Informatics education activities. Some people have changed affiliation since then.

• • Informatics Research Evaluation, 2025 Revised Report
    Summary ¦¦ Full Report 
    Date: March 2025
    Details: Revised version of the report published in 2018 with updated recommendations on Informatics research evaluation.
  • News Section: “Research Evaluation in Informatics” 
    Read More
    Date: April 2018 
    Details: A section about “Research Evaluation in Informatics" was published in the ERCIM News (Issue 113). 
  • Informatics Research Evaluation, 2018 Revised Report
    Summary ¦¦ Full Report
    Date: March 2018 
    Details: Updating the contents and reinforcing the lasting issues raised in the previous IE report on research evaluation.
  • Research Evaluation Activity Progress Update
    Read More
    Date: 24 October 2017
    Details: An update on the progress of the Research Evaluation activity was presented at the special session on Informatics Europe activities during the ECSS 2017.
  • Discussion Panel on Research Evaluation
    Read More
    Date: 26 October 2016
    Details: A discussion panel on Research Evaluation was held as part of the program of the ECSS 2016.
  • Paper "Research Evaluation for Computer Science"
    Read More
    Date: April 2009
    Details: Viewpoint about the Research Evaluation for Computer Science published in the Communications of the ACM, Vol. 52 No. 4, Pages 31-34, 2009. 
  • Report "Research Evaluation for Computer Science"
    Read More
    Date: 20 May 2008
    Details: The first version of the report detailing the evaluation of research in computer science. 

• CRA

  • Best Practices Memo - Incentivizing Quality and Impact: Evaluating Scholarship in Hiring, Tenure, and Promotion (2015)
  • Best Practices Memo - Evaluating Computer Scientists and Engineers For Promotion and Tenure (1999)

  Académie des Sciences, Leopoldina and Royal Society

  • Statement on good practice in the evaluation of researchers and research programmes

  European University Association

  • Reflections on University Research Assessment: key concepts, issues and actors
  • 2017-2018 EUA Open Access Survey Results