Evidence map›Paper›PMID 24971044›Full record

ArticleGerman medical science : GMS e-journal2014

Evaluation of medical research performance--position paper of the Association of the Scientific Medical Societies in Germany (AWMF).

Christoph Herrmann-Lingen, Edgar Brunner, Sibylle Hildenbrand, Thomas H Loew, Tobias Raupach, Claudia Spies, Rolf-Detlef Treede, Christian-Friedrich Vahl, Hans-Jürgen Wenz

Abstract readConsensus Statement
In one paragraph

Article in German medical science : GMS e-journal, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Evaluating Journal Impact Factor: a systematic survey of the pros and cons, and overview of alternative measures.The journal of venomous animals and toxins including tropical diseases · 2020
    Article
  5. Article
  6. Article
  7. Article
  8. [Start-up grants for young scientists in German medical universities : Can the clinical scientist be saved?]Der Chirurg; Zeitschrift fur alle Gebiete der operativen Medizen · 2016
    Article
  9. Innovative surgical sciences · 2016
    Article
  10. A Metrics Ontology. An intellectual infrastructure for defining, managing, and applying metrics.Knowledge organization for a sustainable world: challenges and perspectives for cultural, scientific, and technological sharing in a connected society : proceedings of the fourteenth international ISKO conference 27-29 September 2016 Ri... · 2016
    Article
  11. Article
  12. [Postdoctoral lecturer thesis in medicine: academic competence or career booster?].Der Chirurg; Zeitschrift fur alle Gebiete der operativen Medizen · 2016
    Article
  13. Article
  14. Article
  15. Article
  16. An Evaluation Index System for Research Efficiency of Research-Oriented Hospitals in China.Inquiry : a journal of medical care organization, provision and financing
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Christoph Herrmann-LingenDepartment of Psychosomatic Medicine and Psychotherapy, University of Göttingen Medical Center, Göttingen, Germany.
Edgar BrunnerInstitute for Medical Statistics, University of Göttingen Medical Center, Göttingen, Germany.
Sibylle HildenbrandInstitute of Occupational and Social Medicine and Health Services Research, University Hospital of Tübingen, Tübingen, Germany.
Thomas H LoewDepartment of Psychosomatics, University Hospital of Regensburg, Regensburg, Germany.
Tobias RaupachDepartment of Cardiology and Pneumology, University of Göttingen Medical Center, Göttingen, Germany.
Claudia SpiesDepartment for Anesthesiology and Surgical Intensive Care, Charité Berlin, Berlin, Germany.
Rolf-Detlef TreedeCBTM Neurophysiology, Medical Faculty Mannheim of Heidelberg University, Mannheim, Germany.
Christian-Friedrich VahlDepartment of Cardiothoracic and Vascular Surgery, University of Mainz Medical Center, Mainz, Germany.
Hans-Jürgen WenzClinic of Prosthodontics, Propaedeutics and Dental Materials, Christian-Albrechts-University Kiel, Kiel, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists' careers. However, it is often based on vaguely defined aims and questionable methods and can thereby lead to unwanted regulatory effects. The current paper aims at defining the position of German academic medicine toward the aims, methods, and consequences of its evaluation.

methodsDuring the Berlin Forum of the Association of the Scientific Medical Societies in Germany (AWMF) held on 18 October 2013, international experts presented data on methods for evaluating medical research performance. Subsequent discussions among representatives of relevant scientific organizations and within three ad-hoc writing groups led to a first draft of this article. Further discussions within the AWMF Committee for Evaluation of Performance in Research and Teaching and the AWMF Executive Board resulted in the final consented version presented here.

resultsThe AWMF recommends modifications to the current system of evaluating medical research performance. Evaluations should follow clearly defined and communicated aims and consist of both summative and formative components. Informed peer reviews are valuable but feasible in longer time intervals only. They can be complemented by objective indicators. However, the Journal Impact Factor is not an appropriate measure for evaluating individual publications or their authors. The scientific "impact" rather requires multidimensional evaluation. Indicators of potential relevance in this context may include, e.g., normalized citation rates of scientific publications, other forms of reception by the scientific community and the public, and activities in scientific organizations, research synthesis and science communication. In addition, differentiated recommendations are made for evaluating the acquisition of third-party funds and the promotion of junior scientists.

conclusionsWith the explicit recommendations presented in the current position paper, the AWMF suggests enhancements to the practice of evaluating medical research performance by faculties, ministries and research funding organizations.

Indexed as

Guidelines as TopicBiomedical ResearchEmployee Performance AppraisalFinancing, OrganizedGermanyPeer ReviewPeriodicals as Topic

Identifiers

PMID24971044
PMCPMC4071625

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.