Evidence map›Paper›PMID 17513286›Full record

ArticleJournal of medical Internet research2007

A survey of quality assurance practices in biomedical open source software projects.

Günes Koru, Khaled El Emam, Angelica Neisa, Medha Umarji

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2007. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. PipeVal: light-weight extensible tool for file validation.Bioinformatics (Oxford, England) · 2024
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Quality assurance for the query and distribution systems of the RCSB Protein Data Bank.Database : the journal of biological databases and curation · 2011
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Günes KoruDepartment of Information Systems, University of Maryland, Baltimore, MD, USA.
Khaled El Emam
Angelica Neisa
Medha Umarji

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOpen source (OS) software is continuously gaining recognition and use in the biomedical domain, for example, in health informatics and bioinformatics.

objectivesGiven the mission critical nature of applications in this domain and their potential impact on patient safety, it is important to understand to what degree and how effectively biomedical OS developers perform standard quality assurance (QA) activities such as peer reviews and testing. This would allow the users of biomedical OS software to better understand the quality risks, if any, and the developers to identify process improvement opportunities to produce higher quality software.

methodsA survey of developers working on biomedical OS projects was conducted to examine the QA activities that are performed. We took a descriptive approach to summarize the implementation of QA activities and then examined some of the factors that may be related to the implementation of such practices.

resultsOur descriptive results show that 63% (95% CI, 54-72) of projects did not include peer reviews in their development process, while 82% (95% CI, 75-89) did include testing. Approximately 74% (95% CI, 67-81) of developers did not have a background in computing, 80% (95% CI, 74-87) were paid for their contributions to the project, and 52% (95% CI, 43-60) had PhDs. A multivariate logistic regression model to predict the implementation of peer reviews was not significant (likelihood ratio test = 16.86, 9 df, P = .051) and neither was a model to predict the implementation of testing (likelihood ratio test = 3.34, 9 df, P = .95).

conclusionsLess attention is paid to peer review than testing. However, the former is a complementary, and necessary, QA practice rather than an alternative. Therefore, one can argue that there are quality risks, at least at this point in time, in transitioning biomedical OS software into any critical settings that may have operational, financial, or safety implications. Developers of biomedical OS applications should invest more effort in implementing systemic peer review practices throughout the development and maintenance processes.

Indexed as

Medical InformaticsPeer ReviewSoftware ValidationData CollectionIntellectual PropertyLogistic ModelsQuality ControlSoftwareSoftware DesignSurveys and Questionnaires

Identifiers

PMID17513286
PMCPMC1874720

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.