Evidence map›Paper›PMID 33016886›Full record

ArticleJMIR mHealth and uHealth2020

Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study.

Pim van Oirschot, Marco Heerings, Karine Wendrich, Bram den Teuling, Marijn B Martens, Peter J Jongen

Open access · goldAbstract read
In one paragraph

Article in JMIR mHealth and uHealth, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
2.9field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 43 citations in OpenAlex.

  1. A smartphone sensor-based digital outcome assessment of multiple sclerosis.Multiple sclerosis (Houndmills, Basingstoke, England) · 2022
    Trial
  2. Selective associations between cognitive practice effects and reactive balance adaptation in multiple sclerosis.Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists · 2026
    Article
  3. Article
  4. Article
  5. Heterogeneous Deep Gray Matter Iron Deposition Patterns across Multiple Sclerosis Subgroups Defined by the Clinico-Radiological Paradox.Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics · 2026
    Article
  6. Review
  7. Rationale and design of the Renal Lifecycle trial assessing the effect of dapagliflozin on cardiorenal outcomes in severe chronic kidney disease.Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association · 2025 · on this map
    Article
  8. Plateau of practice effects and noise with repeat SDMT testing in multiple sclerosis.Multiple sclerosis (Houndmills, Basingstoke, England) · 2025
    Article
  9. Article
  10. Differential Validity in the Written, Oral, and Electronic SDMT in Multiple Sclerosis.Multiple sclerosis (Houndmills, Basingstoke, England) · 2025
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Observational
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 3 institutions in 2 countries.

Pim van OirschotOrikami Digital Health Products, Nijmegen, Netherlands.ORCID 0000-0003-1135-0500
Marco HeeringsDutch National MS Foundation, Rotterdam, Netherlands.ORCID 0000-0002-9914-042X
Karine WendrichFaculty of Science, Institute for Science in Society, Radboud University, Nijmegen, Netherlands.ORCID 0000-0001-9413-1674
Bram den TeulingOrikami Digital Health Products, Nijmegen, Netherlands.ORCID 0000-0001-9084-5645
Marijn B MartensDrug Target ID, Nijmegen, Netherlands.ORCID 0000-0002-5196-5131
Peter J JongenDepartment of Community & Occupational Medicine, University Medical Centre Groningen, Groningen, Netherlands.ORCID 0000-0002-9202-6309
Radboud University Nijmegen · NLTarget (United States) · USUniversity Medical Center Groningen · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS.

objectiveThe aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT).

methodsWe performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the "HC matched" group) and 58 subjects had a less intense assessment schedule to determine reference values (the "HC normative" group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT.

resultsThe SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS.

conclusionsThe high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Indexed as

Mobile ApplicationsMultiple SclerosisHumansNeuropsychological TestsReproducibility of ResultsSmartphonecognitionmobile phoneprocessing speedrelapsing-remitting multiple sclerosis

Identifiers

PMID33016886
PMCPMC7573704
OpenAlexW3089623732

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.