Evidence map›Paper›PMID 34225782›Full record

ArticleTrials2021

Using routinely recorded data in a UK RCT: a comparison to standard prospective data collection methods.

G A Powell, L J Bonnett, C T Smith, D A Hughes, P R Williamson, A G Marson

Open access · goldAbstract read
In one paragraph

Article in Trials, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
1.8field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it, 10 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Observational
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

G A PowellDepartment of Molecular and Clinical Pharmacology, Clinical Sciences Centre, Lower Lane, Fazakerley, Liverpool, L9 7LJ, UK. gpowell@liv.ac.uk.ORCID https://orcid.org/0000-0003-3840-2534
L J BonnettDepartment of Biostatistics, University of Liverpool, Waterhouse Building, Block F, 1-5 Brownlow Street, Liverpool, L69 3GL, UK.ORCID https://orcid.org/0000-0002-6981-9212
C T SmithDepartment of Biostatistics, University of Liverpool, Waterhouse Building, Block F, 1-5 Brownlow Street, Liverpool, L69 3GL, UK.ORCID https://orcid.org/0000-0003-3051-1445
D A HughesCentre for Health Economics & Medicines Evaluation, Bangor University, Ardudwy, Normal Site, Gwynedd, North Wales, LL57 2PZ, UK.ORCID https://orcid.org/0000-0001-8247-7459
P R WilliamsonDepartment of Biostatistics, University of Liverpool, Waterhouse Building, Block F, 1-5 Brownlow Street, Liverpool, L69 3GL, UK.ORCID https://orcid.org/0000-0001-9802-6636
A G MarsonDepartment of Molecular and Clinical Pharmacology, Clinical Sciences Centre, Lower Lane, Fazakerley, Liverpool, L9 7LJ, UK.ORCID https://orcid.org/0000-0002-6861-8806
University of Liverpool · GBBangor University · GB

Funding

Medical Research Council MR/K025635/1Medical Research Council MR/L004933/2/P16
6 · The paper itself

Abstract

backgroundRoutinely recorded data held in electronic health records can be used to inform the conduct of randomised controlled trials (RCTs). However, limitations with access and accuracy have been identified.

objectiveUsing epilepsy as an exemplar condition, we assessed the attributes and agreement of routinely recorded data compared to data collected using case report forms in a UK RCT assessing antiepileptic drug treatments for individuals newly diagnosed with epilepsy.

methodsThe case study RCT is the Standard and New Antiepileptic Drugs II (SANAD II) trial, a pragmatic, UK multicentre RCT assessing the clinical and cost-effectiveness of antiepileptic drugs as treatments for epilepsy. Ninety-eight of 470 eligible participants provided consent for access to routinely recorded secondary care data that were retrieved from NHS Digital Hospital Episode Statistics (N=71) and primary and secondary care data from The Secure Anonymised Information Linkage Databank (N=27). We assessed data items relevant to the identification of individuals eligible for inclusion in SANAD II, baseline and follow-up visits. The attributes of routinely recorded data were assessed including the degree of missing data. The agreement between routinely recorded data and data collected on case report forms in SANAD II was assessed using calculation of Cohen's kappa for categorical data and construction of Bland-Altman plots for continuous data.

resultsThere was a significant degree of missing data in the routine record for 15 of the 20 variables assessed, including all clinical variables. Agreement was poor for the majority of comparisons, including the assessments of seizure occurrence and adverse events. For example, only 23/62 (37%) participants had a date of first-ever seizure identified in routine datasets. Agreement was satisfactory for the date of prescription of antiepileptic drugs and episodes of healthcare resource use.

conclusionsThere are currently significant limitations preventing the use of routinely recorded data for participant identification and assessment of clinical outcomes in epilepsy, and potentially other chronic conditions. Further research is urgently required to assess the attributes, agreement, additional benefits, cost-effectiveness and 'optimal mix' of routinely recorded data compared to data collected using standard methods such as case report forms at clinic visits for people with epilepsy.

trial registrationStandard and New Antiepileptic Drugs II (SANAD II (EudraCT No: 2012-001884-64, registered 05/09/2012; ISRCTN Number: ISRCTN30294119 , registered 03/07/2012)).

Indexed as

AnticonvulsantsEpilepsyElectronic Health RecordsHumansMulticenter Studies as TopicPragmatic Clinical Trials as TopicRandomized Controlled Trials as TopicSeizuresUnited KingdomAnticonvulsantsAdministrative dataAgreementRandomised controlled trialRoutine data

Identifiers

PMID34225782
PMCPMC8259387
OpenAlexW3169687990

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.