Evidence map›Paper›PMID 31436166›Full record

ArticleJMIR medical education2019

Association of Online Learning Behavior and Learning Outcomes for Medical Students: Large-Scale Usage Data Analysis.

Martina Bientzle, Emrah Hircin, Joachim Kimmerle, Christian Knipfer, Ralf Smeets, Robert Gaudin, Peter Holtz

Open access · goldAbstract read
In one paragraph

Article in JMIR medical education, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
5.3field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 23 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Big Data for Biomedical Education with a Focus on the COVID-19 Era: An Integrative Review of the Literature.International journal of environmental research and public health · 2021
    Review
  6. Article
  7. Article
  8. Journal der Deutschen Dermatologischen Gesellschaft = Journal of the German Society of Dermatology : JDDG · 2020
    Review
  9. Review
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 2 countries.

Martina Bientzle *Leibniz-Institut für Wissensmedien (Knowledge Media Research Center), Tübingen, Germany.ORCID http://orcid.org/0000-0002-1312-4032
Emrah Hircin *AMBOSS GmbH, Cologne, Germany.ORCID http://orcid.org/0000-0001-9893-0684
Joachim KimmerleLeibniz-Institut für Wissensmedien (Knowledge Media Research Center), Tübingen, Germany.ORCID http://orcid.org/0000-0002-6345-9498
Christian KnipferDepartment of Oral Maxillofacial Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.ORCID http://orcid.org/0000-0001-6478-4834
Ralf SmeetsDepartment of Oral Maxillofacial Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.ORCID http://orcid.org/0000-0002-0207-5474
Robert GaudinLaboratory for Innovation Science at Harvard, Harvard University, Cambridge, MA, United States.ORCID http://orcid.org/0000-0001-9061-7220
Peter HoltzLeibniz-Institut für Wissensmedien (Knowledge Media Research Center), Tübingen, Germany.ORCID http://orcid.org/0000-0001-7539-6992
Leibniz-Institut für Wissensmedien · DEUniversität Hamburg · DEHarvard University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDigital learning environments have become very common in the training of medical professionals, and students often use such platforms for exam preparation. Multiple choice questions (MCQs) are a common format in medical exams and are used by students to prepare for said exams.

objectiveWe aimed to examine whether particular learning activities contributed more strongly than others to users' exam performance.

methodsWe analyzed data from users of an online platform that provides learning materials for medical students in preparation for their final exams. We analyzed whether the number of learning cards viewed and the number of MCQs taken were positively related to learning outcomes. We also examined whether viewing learning cards or answering MCQs was more effective. Finally, we tested whether taking individual notes predicted learning outcomes, and whether taking notes had an effect after controlling for the effects of learning cards and MCQs. Our analyses from the online platform Amboss are based on user activity data, which supplied the number of learning cards studied and test questions answered. We also included the number of notes from each of those 23,633 users who had studied at least 200 learning cards and had answered at least 1000 test exam questions in the 180 days before their state exam. The activity data for this analysis was collected retrospectively, using Amboss archival usage data from April 2014 to April 2017. Learning outcomes were measured using the final state exam scores that were calculated by using the answers voluntarily entered by the participants.

resultsWe found correlations between the number of cards studied (r=.22; P<.001) and the number of test questions that had been answered (r=.23; P<.001) with the percentage of correct answers in the learners' medical exams. The number of test questions answered still yielded a significant effect, even after controlling for the number of learning cards studied using a hierarchical regression analysis (β=.14; P<.001; ΔR

conclusionsThese results show that online learning platforms are particularly helpful whenever learners engage in active elaboration in learning material, such as by answering MCQs or taking notes.

Indexed as

big data analyticslearning engagementlearning outcomesmedical online learning platformwriting notes

Identifiers

PMID31436166
PMCPMC6724501
OpenAlexW2969243049

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.