Evidence map›Paper›PMID 35646195›Full record

ArticleEducational assessment, evaluation and accountability2023

How sensitive are the evaluations of a school's effectiveness to the selection of covariates in the applied value-added model?

Jessica Levy, Martin Brunner, Ulrich Keller, Antoine Fischbach

Abstract read
In one paragraph

Article in Educational assessment, evaluation and accountability, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. The genetic lottery goes to school: Better schools compensate for the effects of students' genetic differences.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  2. Mixed-Effects Location Scale Models for Joint Modeling School Value-Added Effects on the Mean and Variance of Student Achievement.Journal of educational and behavioral statistics : a quarterly publication sponsored by the American Educational Research Association and the American Statistical Association · 2024
    Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Jessica LevyLuxembourg Centre for Educational Testing, Faculty of Humanities, Education and Social Sciences, University of Luxembourg, 11, Porte des Sciences, L-4366 Esch-sur-Alzette, Luxembourg.ORCID 0000-0003-2825-9412
Martin BrunnerDepartment of Education, University of Potsdam, Karl-Liebknecht-Str. 24-25, 14476 Potsdam, Germany.
Ulrich KellerLuxembourg Centre for Educational Testing, Faculty of Humanities, Education and Social Sciences, University of Luxembourg, 11, Porte des Sciences, L-4366 Esch-sur-Alzette, Luxembourg.
Antoine FischbachLuxembourg Centre for Educational Testing, Faculty of Humanities, Education and Social Sciences, University of Luxembourg, 11, Porte des Sciences, L-4366 Esch-sur-Alzette, Luxembourg.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

There is no final consensus regarding which covariates should be used (in addition to prior achievement) when estimating value-added (VA) scores to evaluate a school's effectiveness. Therefore, we examined the sensitivity of evaluations of schools' effectiveness in math and language achievement to covariate selection in the applied VA model. Four covariate sets were systematically combined, including prior achievement from the same or different domain, sociodemographic and sociocultural background characteristics, and domain-specific achievement motivation. School VA scores were estimated using longitudinal data from the Luxembourg School Monitoring Programme with some 3600 students attending 153 primary schools in Grades 1 and 3. VA scores varied considerably, despite high correlations between VA scores based on the different sets of covariates (.66 < Supplementary Information: The online version contains supplementary material available at 10.1007/s11092-022-09386-y.

Indexed as

AccountabilityElementary schoolMultilevel modelsValue-added models

Identifiers

PMID35646195
PMCPMC9127485

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.