Evidence map›Paper›PMID 36827260›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2023

Reimagining the machine learning life cycle to improve educational outcomes of students.

Lydia T Liu, Serena Wang, Tolani Britton, Rediet Abebe

Open access · hybridAbstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
6.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed, 24 citations in OpenAlex.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

Lydia T LiuDepartment of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94709.ORCID 0000-0002-9603-3346
Serena WangDepartment of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94709.
Tolani BrittonBerkeley School of Education, University of California, Berkeley, CA 94704.
Rediet AbebeHarvard Society of Fellows, Cambridge, MA 02138.ORCID 0000-0002-5487-9108
University of California, Berkeley · USHarvard University Press · US

Funding

National Science Foundation (NSF) DGE 1752814
6 · The paper itself

Abstract

Machine learning (ML) techniques are increasingly prevalent in education, from their use in predicting student dropout to assisting in university admissions and facilitating the rise of massive open online courses (MOOCs). Given the rapid growth of these novel uses, there is a pressing need to investigate how ML techniques support long-standing education principles and goals. In this work, we shed light on this complex landscape drawing on qualitative insights from interviews with education experts. These interviews comprise in-depth evaluations of ML for education (ML4Ed) papers published in preeminent applied ML conferences over the past decade. Our central research goal is to critically examine how the stated or implied education and societal objectives of these papers are aligned with the ML problems they tackle. That is, to what extent does the technical problem formulation, objectives, approach, and interpretation of results align with the education problem at hand? We find that a cross-disciplinary gap exists and is particularly salient in two parts of the ML life cycle: the formulation of an ML problem from education goals and the translation of predictions to interventions. We use these insights to propose an extended ML life cycle, which may also apply to the use of ML in other domains. Our work joins a growing number of meta-analytical studies across education and ML research as well as critical analyses of the societal impact of ML. Specifically, it fills a gap between the prevailing technical understanding of machine learning and the perspective of education researchers working with students and in policy.

Indexed as

GoalsMachine LearningStudentsHumansalgorithmic fairnesseducation interventionseducation technologiesmachine learning for social goodproblem formulation

Identifiers

PMID36827260
PMCPMC9992853
OpenAlexW4321749684

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.