Evidence map›Paper›PMID 34589023›Full record

ReviewFrontiers in psychology2021

Organizing the Methodological Toolbox: Lessons Learned From Implementing Developmental Methods Online.

Jonathan F Kominsky, Katarina Begus, Ilona Bass, Joseph Colantonio, Julia A Leonard, Allyson P Mackey, Elizabeth Bonawitz

Abstract readReview
In one paragraph

Review in Frontiers in psychology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. The Feasibility of Remote Visual-World Eye-Tracking With Young Children.Open mind : discoveries in cognitive science · 2025
    Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Conducting Developmental Research Online vs. In-Person: A Meta-Analysis.Open mind : discoveries in cognitive science · 2024
    Article
  10. Article
  11. Article
  12. Article
  13. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood.Infancy : the official journal of the International Society on Infant Studies
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Jonathan F KominskyGraduate School of Education, Harvard University, Cambridge, MA, United States.
Katarina BegusGraduate School of Education, Harvard University, Cambridge, MA, United States.
Ilona BassGraduate School of Education, Harvard University, Cambridge, MA, United States.
Joseph ColantonioDepartment of Psychology, Rutgers University, Newark, NJ, United States.
Julia A LeonardDepartment of Psychology, University of Pennsylvania, Philadelphia, PA, United States.
Allyson P MackeyDepartment of Psychology, University of Pennsylvania, Philadelphia, PA, United States.
Elizabeth BonawitzGraduate School of Education, Harvard University, Cambridge, MA, United States.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Adapting studies typically run in the lab, preschool, or museum to online data collection presents a variety of challenges. The solutions to those challenges depend heavily on the specific questions pursued, the methods used, and the constraints imposed by available technology. We present a partial sample of solutions, discussing approaches we have developed for adapting studies targeting a range of different developmental populations, from infants to school-aged children, and utilizing various online methods such as high-framerate video presentation, having participants interact with a display on their own computer, having the experimenter interact with both the participant and an actor, recording free-play with physical objects, recording infant looking times both offline and live, and more. We also raise issues and solutions regarding recruitment and representativeness in online samples. By identifying the concrete needs of a given approach, tools that meet each of those individual needs, and interfaces between those tools, we have been able to implement many (but not all) of our studies using online data collection during the COVID-19 pandemic. This systematic review aligning available tools and approaches with different methods can inform the design of future studies, in and outside of the lab.

Indexed as

behavioral methodsdevelopmental psychologyearly childhoodinfantmetascienceonline studies

Identifiers

PMID34589023
PMCPMC8473607

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.