Evidence map›Paper›PMID 33557853›Full record

ArticlePopulation health metrics2021

Paradata analyses to inform population-based survey capture of pregnancy outcomes: EN-INDEPTH study.

Vladimir Sergeevich Gordeev, Joseph Akuze, Angela Baschieri, Sanne M Thysen, Francis Dzabeng, M Moinuddin Haider, Melanie Smuk, Michael Wild, Michael M Lokshin, Temesgen Azemeraw Yitayew and 7 more

Abstract read
In one paragraph

Article in Population health metrics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Vladimir Sergeevich GordeevInstitute of Population Health Sciences, Queen Mary University of London, London, UK. v.gordeev@qmul.ac.uk.
Joseph AkuzeMaternal, Adolescent, Reproductive & Child Health (MARCH) Centre, London School of Hygiene & Tropical Medicine, London, UK.
Angela BaschieriMaternal, Adolescent, Reproductive & Child Health (MARCH) Centre, London School of Hygiene & Tropical Medicine, London, UK.
Sanne M ThysenBandim Health Project, Bissau, Guinea-Bissau.
Francis DzabengKintampo Health Research Centre, Kintampo, Ghana.
M Moinuddin HaiderHealth Systems and Population Studies Division, icddr,b, Dhaka, Bangladesh.
Melanie SmukDepartment of Medical Statistics, London School of Hygiene & Tropical Medicine, London, UK.
Michael WildThe World Bank, Washington DC, USA.
Michael M LokshinThe World Bank, Washington DC, USA.
Temesgen Azemeraw YitayewDabat Research Centre Health and Demographic Surveillance System, Dabat, Ethiopia.
Solomon Mokonnen AbebeDabat Research Centre Health and Demographic Surveillance System, Dabat, Ethiopia.
Davis NatukwatsaIgangaMayuge Health and Demographic Surveillance System, Makerere University Centre for Health and Population Research, Makerere, Uganda.
Collins GyezahoIgangaMayuge Health and Demographic Surveillance System, Makerere University Centre for Health and Population Research, Makerere, Uganda.
Seeba Amenga-EtegoKintampo Health Research Centre, Kintampo, Ghana.
Joy E Lawn *Maternal, Adolescent, Reproductive & Child Health (MARCH) Centre, London School of Hygiene & Tropical Medicine, London, UK.
Hannah Blencowe *Maternal, Adolescent, Reproductive & Child Health (MARCH) Centre, London School of Hygiene & Tropical Medicine, London, UK.
Every Newborn-INDEPTH Study Collaborative Group

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundParadata are (timestamped) records tracking the process of (electronic) data collection. We analysed paradata from a large household survey of questions capturing pregnancy outcomes to assess performance (timing and correction processes). We examined how paradata can be used to inform and improve questionnaire design and survey implementation in nationally representative household surveys, the major source for maternal and newborn health data worldwide.

methodsThe EN-INDEPTH cross-sectional population-based survey of women of reproductive age in five Health and Demographic Surveillance System sites (in Bangladesh, Guinea-Bissau, Ethiopia, Ghana, and Uganda) randomly compared two modules to capture pregnancy outcomes: full pregnancy history (FPH) and the standard DHS-7 full birth history (FBH+). We used paradata related to answers recorded on tablets using the Survey Solutions platform. We evaluated the difference in paradata entries between the two reproductive modules and assessed which question characteristics (type, nature, structure) affect answer correction rates, using regression analyses. We also proposed and tested a new classification of answer correction types.

resultsWe analysed 3.6 million timestamped entries from 65,768 interviews. 83.7% of all interviews had at least one corrected answer to a question. Of 3.3 million analysed questions, 7.5% had at least one correction. Among corrected questions, the median number of corrections was one, regardless of question characteristics. We classified answer corrections into eight types (no correction, impulsive, flat (simple), zigzag, flat zigzag, missing after correction, missing after flat (zigzag) correction, missing/incomplete). 84.6% of all corrections were judged not to be problematic with a flat (simple) mistake correction. Question characteristics were important predictors of probability to make answer corrections, even after adjusting for respondent's characteristics and location, with interviewer clustering accounted as a fixed effect. Answer correction patterns and types were similar between FPH and FBH+, as well as the overall response duration. Avoiding corrections has the potential to reduce interview duration and reproductive module completion by 0.4 min.

conclusionsThe use of questionnaire paradata has the potential to improve measurement and the resultant quality of electronic data. Identifying sections or specific questions with multiple corrections sheds light on typically hidden challenges in the survey's content, process, and administration, allowing for earlier real-time intervention (e.g.,, questionnaire content revision or additional staff training). Given the size and complexity of paradata, additional time, data management, and programming skills are required to realise its potential.

Indexed as

Cross-Sectional StudiesBangladeshEthiopiaFemaleHumansInfant, NewbornPregnancySurveys and QuestionnairesUgandaAnswer correction typeNeonatalNewbornParadataSurveySurvey design

Identifiers

PMID33557853
PMCPMC7869213

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.