Evidence map›Paper›PMID 39738808›Full record

ArticleBehavior research methods2024

Assessing handwriting skills in a web browser: Development and validation of an automated online test in Japanese Kanji.

Tomohiro Inoue, Yucan Chen, Toshio Ohyanagi

Abstract readValidation Study
In one paragraph

Article in Behavior research methods, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Tomohiro InoueDepartment of Psychology, The Chinese University of Hong Kong, Hong Kong SAR, China. tinoue@cuhk.edu.hk.ORCID 0000-0001-8163-087X
Yucan ChenDepartment of Psychology, The Chinese University of Hong Kong, Hong Kong SAR, China.ORCID 0009-0005-9544-5700
Toshio OhyanagiDepartment of Liberal Arts and Sciences, Sapporo Medical University, Sapporo, Japan.ORCID 0000-0001-8335-3087

Funding

Research Grants Council, University Grants Committee 14617721
6 · The paper itself

Abstract

Online language and literacy assessments have become prevalent in research and practice across settings. However, a notable exception is the assessment of handwriting and spelling, which has traditionally been conducted in person with paper and pencil. In light of this, we developed an automated, browser-based handwriting test application (Online Assessment of Handwriting and Spelling: OAHaS) for Japanese Kanji (Study 1) and examined its psychometric properties (Study 2). The automated scoring function using convolutional neural network (CNN) models achieved high recall (98.7%) and specificity (84.4%), as well as high agreement with manual scoring (95.4%). Additionally, behavioral validation with data from primary school children (N = 261, 49.0% female, age range = 6-12 years) indicated the high reliability and validity of our online test application, with a strong correlation between children's scores on the online and paper-based tests (r = .86). Moreover, our analysis indicated the potential utility of writing fluency measures (latency and duration) that are automatically recorded by OAHaS. Taken together, our browser-based application demonstrated the feasibility and viability of remote and automated assessment of handwriting skills, providing a streamlined approach to research and practice on handwriting. The source code of the application and supporting materials are available on Open Science Framework ( https://osf.io/gver2/ ).

Indexed as

HandwritingChildEast Asian PeopleFemaleHumansJapanMaleNeural Networks, ComputerPsychometricsReproducibility of ResultsWeb BrowserAutomated online assessmentConvolutional neural networkHandwritingJapanese Kanji

Identifiers

PMID39738808
PMCPMC11685258

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.