Evidence map›Paper›PMID 30938683›Full record

ArticleJMIR medical education2019

Data Collection Approaches to Enable Evaluation of a Massive Open Online Course About Data Science for Continuing Education in Health Care: Case Study.

Abrar Alturkistani, Azeem Majeed, Josip Car, David Brindley, Glenn Wells, Edward Meinert

Abstract read
In one paragraph

Article in JMIR medical education, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Abrar AlturkistaniGlobal Digital Health Unit, Department of Primary Care and Public Health, Imperial College London, London, United Kingdom.ORCID http://orcid.org/0000-0001-7935-8870
Azeem MajeedDepartment of Primary Care and Public Health, Imperial College London, London, United Kingdom.ORCID http://orcid.org/0000-0002-2357-9858
Josip CarGlobal Digital Health Unit, Department of Primary Care and Public Health, Imperial College London, London, United Kingdom.ORCID http://orcid.org/0000-0001-8969-371X
David BrindleyHealthcare Translation Research Group, Department of Paediatrics, University of Oxford, Oxford, United Kingdom.ORCID http://orcid.org/0000-0002-5166-8583
Glenn WellsOxford Academic Health Science Centre, Oxford, United Kingdom.ORCID http://orcid.org/0000-0003-3373-584X
Edward MeinertGlobal Digital Health Unit, Department of Primary Care and Public Health, Imperial College London, London, United Kingdom.ORCID http://orcid.org/0000-0003-2484-3347

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThis study presents learner perceptions of a pilot massive open online course (MOOC).

objectiveThe objective of this study was to explore data collection approaches to help inform future MOOC evaluations on the use of semistructured interviews and the Kirkpatrick evaluation model.

methodsA total of 191 learners joined 2 course runs of a limited trial of the MOOC. Moreover, 7 learners volunteered to be interviewed for the study. The study design drew on semistructured interviews of 2 learners transcribed and analyzed using Braun and Clark's method for thematic coding. This limited participant set was used to identify how the Kirkpatrick evaluation model could be used to evaluate further implementations of the course at scale.

resultsThe study identified several themes that could be used for further analysis. The themes and subthemes include learner background (educational, professional, and topic significance), MOOC learning (learning achievement and MOOC application), and MOOC features (MOOC positives, MOOC negatives, and networking). There were insufficient data points to perform a Kirkpatrick evaluation.

conclusionsSemistructured interviews for MOOC evaluation can provide a valuable in-depth analysis of learners' experience of the course. However, there must be sufficient data sources to complete a Kirkpatrick evaluation to provide for data triangulation. For example, data from precourse and postcourse surveys, quizzes, and test results could be used to improve the evaluation methodology.

Indexed as

educationeducation, distancemassive open online courseMOOConline educationonline learningteaching

Identifiers

PMID30938683
PMCPMC6465971

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.