Evidence map›Paper›PMID 42308504›Full record

ArticleJournal of medical Internet research2026

Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research.

Sonja Harkener, Oliver J Bott, Christian Draeger, Tobias Hartz, Ekkehart Jenetzky, Matthias Löbe, Stefanie March, Chris Schubert, Jürgen Stausberg

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Sonja HarkenerInstitute for Medical Informatics, Biometry and Epidemiology, Faculty of Medicine, University of Duisburg-Essen, Hufelandstr. 55, Essen, North Rhine-Westphalia, 45122, Germany, 49 201 72377201.ORCID http://orcid.org/0009-0003-8128-1368
Oliver J BottInstitute for Applied Data Science Hannover (DATA|H), Hochschule Hannover - University of Applied Sciences and Arts, Hannover, Lower Saxony, Germany.ORCID http://orcid.org/0000-0002-8823-5247
Christian DraegerInstitute for Medical Informatics, Statistics and Epidemiology, University of Leipzig, Leipzig, Saxony, Germany.ORCID http://orcid.org/0000-0001-8835-4548
Tobias HartzClinical Cancer Registry Lower Saxony, Hannover, Germany.ORCID http://orcid.org/0000-0002-1704-0338
Ekkehart JenetzkyFaculty of Health/School of Medicine, Witten/Herdecke University, Witten, North Rhine-Westphalia, Germany.ORCID http://orcid.org/0000-0001-5415-8784
Matthias LöbeInstitute for Medical Informatics, Statistics and Epidemiology, University of Leipzig, Leipzig, Saxony, Germany.ORCID http://orcid.org/0000-0002-2344-0426
Stefanie MarchMagdeburg-Stendal University of Applied Sciences, Magdeburg, Saxony-Anhalt, Germany.ORCID http://orcid.org/0000-0002-2809-6767
Chris SchubertLibrary, TU Wien, Vienna, Austria.ORCID http://orcid.org/0000-0002-4971-2493
Jürgen StausbergInstitute for Medical Informatics, Biometry and Epidemiology, Faculty of Medicine, University of Duisburg-Essen, Hufelandstr. 55, Essen, North Rhine-Westphalia, 45122, Germany, 49 201 72377201.ORCID http://orcid.org/0000-0003-0348-5579

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: To be beneficial for empirical health research, a dataset must be fit for use. The quality of a dataset can only be influenced during data collection, yet it is evaluated multiple times during analysis or secondary use by applying quality indicators. Objective: This study aimed to establish an up-to-date set of indicators measuring the quality of datasets in empirical health research. Methods: A total of 3 pillars were combined. First, the 51 indicators of a German guideline from 2014 about the management of data quality were revised. Second, a literature review was performed looking for evidence sources since 2013 that describe, propose, or apply dataset quality indicators. Third, indicators were supplemented by a manual search and other sources. The quality indicators were then integrated into the IDEFIM framework. The IDEFIM framework distinguishes between the categories' data, metadata, context, and openness quality. In this work, only the categories data and metadata quality, with their 14 dimensions were considered. Results: In total, 69 indicators qualified for the IDEFIM indicator set, 53 related to the category data quality, and 16 to the category metadata quality. A total of 30 indicators originated from the German guideline, 31 from the literature review. Three indicators were added to cover aspects of diversity, equity, and inclusion, and an additional 5 related to specifics of data and metadata quality not addressed so far. Most indicators were found in the dimensions accuracy (data) with 12 measures, completeness (data) with 12 measures, and consistency (data) with 19 measures. According to the number of supporting evidence sources, missing values in data elements (48 evidence sources), contradictions (31), and currentness (26) were the most popular quality indicators. Metadata quality was significantly less frequently addressed. Conclusions: The presented IDEFIM indicator set can be used for the management of data collections as well as for the verification of a dataset's quality for an intended use. The indicator set should also be considered in the design of a study in empirical health research and the development of software tools supporting the visualization of issues related to the quality of a dataset.

Indexed as

Data AccuracyEmpirical ResearchGermanyHumansMetadatadata qualitydatasetempirical health researchhealth careIDEFIM frameworkmetadataquality indicatorsecondary use

Identifiers

PMID42308504
PMCPMC13274964

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.