Evidence map›Paper›PMID 41058930›Full record

ArticleF1000Research2024

Using text-mining to measure the scientific impact and legacy of ELIXIR, a distributed research infrastructure for life science data.

Francesca De Leo, Erika Balsyte, Robert Petryszak, Marilena D'Ambrosio, Chiara Bruno, Martin Cook, Ivan Mičetić, Corinne S Martin

Abstract read
In one paragraph

Article in F1000Research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Francesca De LeoCNR-IBIOM, Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche, Bari, Italy, 70126, Italy.ORCID 0000-0003-0421-7699
Erika BalsyteELIXIR Hub, Wellcome Genome Campus, Hinxton, England, CB10 1SD, UK.
Robert PetryszakDatasome, Cambridge, UK.
Marilena D'AmbrosioCNR-IBIOM, Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche, Bari, Italy, 70126, Italy.ORCID 0000-0001-7939-0504
Chiara BrunoCNR-IBIOM, Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche, Bari, Italy, 70126, Italy.
Martin CookELIXIR Hub, Wellcome Genome Campus, Hinxton, England, CB10 1SD, UK.
Ivan MičetićUniversita degli Studi di Padova Dipartimento di Scienze Biomediche, Padova, I-35131, Italy.ORCID 0000-0003-1691-8425
Corinne S MartinELIXIR Hub, Wellcome Genome Campus, Hinxton, England, CB10 1SD, UK.ORCID 0000-0002-5428-2766

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: ELIXIR is a pan-European public-funded research infrastructure dedicated to life science data. As such, it must demonstrate public value to its funders and stakeholders. We present methods to inventory research publications linked to ELIXIR that have received funding and support, as well as related citation metrics, used as performance metrics for these audiences. Methods: To overcome challenges inherent in ELIXIR's distributed structure, and the fact that those publishing ELIXIR-supported work are typically working part-time on ELIXIR matters, a semi-automated approach, consisting of text-mining followed by manual curation, is presented. A country-level case study (ELIXIR Italy) refines and expands the methods, notably by introducing more granularity in the curation process (e.g. considering all national-level grants, examining affiliations to report publication per institute) and by additionally looking at the scientific impact of the resources developed and operated by the Italian Node of ELIXIR. Results: Overall, the methods described in this article have shown to: (1) be repeatable with acceptable levels of accuracy and consistency (notably across curators); (2) require reasonable effort in terms of curation of monthly 'harvests' of publications (obtained by text-mining); and (3) to be well-adapted to ELIXIR's distributed nature. Conclusions: Concrete examples are provided of downstream uses of the inventoried publications and their citations, both for ELIXIR as a whole and for the Italian case study. Limitations of the methods are discussed, particularly the challenges associated with using an 'Open literature' database (Europe PMC) for the text-mining, and the constraints related to curation capacity. The methods, along with the valuable lessons learned during their development, are sufficiently generic and pragmatic enough to be readily adapted by other similar research infrastructures.

Indexed as

Biological Science DisciplinesData MiningHumansItalybioinformaticsdatabasefunderKPIliteraturemetricperformanceresource

Identifiers

PMID41058930
PMCPMC12498510

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.