Evidence map›Paper›PMID 37440310›Full record

ArticleJMIR formative research2023

A Novel Mobile App to Identify Patients With Multimorbidity in the Emergency Setting: Development of an App and Feasibility Trial.

Claire Barthlow Rosen, Sanford Eugene Roberts, Solomiya Syvyk, Caitlin Finn, Jason Tong, Christopher Wirtalla, Hunter Spinks, Rachel Rapaport Kelz

Abstract read
In one paragraph

Article in JMIR formative research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. A Qualitative Study on Surgeon Perceptions of Risk Calculators in Emergency General Surgery.Annals of surgery open : perspectives of surgical history, education, and clinical approaches · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Claire Barthlow RosenHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0002-1029-5522
Sanford Eugene RobertsHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0002-5152-3499
Solomiya SyvykHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0003-0908-2746
Caitlin FinnHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0002-1699-8114
Jason TongHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0002-3351-9330
Christopher WirtallaHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0001-6580-7794
Hunter SpinksHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0009-0002-1071-9599
Rachel Rapaport KelzHospital of the University of Pennsylvania, Philadelphia, PA, United States.ORCID https://orcid.org/0000-0001-6635-5961

Funding

Using Outcomes to Guide Treatment of Surgical EmergenciesR01AG060612 · NIA · UNIVERSITY OF PENNSYLVANIA · PI KELZ, RACHEL · 2019 to 2023
$2.7M
Emergency General Surgery Treatment of Older Multimorbid PatientsF32AG074614 · NIA · UNIVERSITY OF PENNSYLVANIA · PI ROSEN, CLAIRE · 2021 to 2022
$149k
NIA NIH HHS F32 AG074614NIA NIH HHS R01 AG060612
6 · The paper itself

Abstract

backgroundMultimorbidity is associated with an increased risk of poor surgical outcomes among older adults; however, identifying multimorbidity in the clinical setting can be a challenge.

objectiveWe created the Multimorbid Patient Identifier App (MMApp) to easily identify patients with multimorbidity identified by the presence of a Qualifying Comorbidity Set and tested its feasibility for use in future clinical research, validation, and eventually to guide clinical decision-making.

methodsWe adapted the Qualifying Comorbidity Sets' claims-based definition of multimorbidity for clinical use through a modified Delphi approach and developed MMApp. A total of 10 residents input 5 hypothetical emergency general surgery patient scenarios, common among older adults, into the MMApp and examined MMApp test characteristics for a total of 50 trials. For MMApp, comorbidities selected for each scenario were recorded, along with the number of comorbidities correctly chosen, incorrectly chosen, and missed for each scenario. The sensitivity and specificity of identifying a patient as multimorbid using MMApp were calculated using composite data from all scenarios. To assess model feasibility, we compared the mean task completion by scenario to that of the American College of Surgeons National Surgical Quality Improvement Program Surgical Risk Calculator (ACS-NSQIP-SRC) using paired t tests. Usability and satisfaction with MMApp were assessed using an 18-item questionnaire administered immediately after completing all 5 scenarios.

resultsThere was no significant difference in the task completion time between the MMApp and the ACS-NSQIP-SRC for scenarios A (86.3 seconds vs 74.3 seconds, P=.85) or C (58.4 seconds vs 68.9 seconds,P=.064), MMapp took less time for scenarios B (76.1 seconds vs 87.4 seconds, P=.03) and E (20.7 seconds vs 73 seconds, P<.001), and more time for scenario D (78.8 seconds vs 58.5 seconds, P=.02). The MMApp identified multimorbidity with 96.7% (29/30) sensitivity and 95% (19/20) specificity. User feedback was positive regarding MMApp's usability, efficiency, and usefulness.

conclusionsThe MMApp identified multimorbidity with high sensitivity and specificity and did not require significantly more time to complete than a commonly used web-based risk-stratification tool for most scenarios. Mean user times were well under 2 minutes. Feedback was overall positive from residents regarding the usability and usefulness of this app, even in the emergency general surgery setting. It would be feasible to use MMApp to identify patients with multimorbidity in the emergency general surgery setting for validation, research, and eventual clinical use. This type of mobile app could serve as a template for other research teams to create a tool to easily screen participants for potential enrollment.

Indexed as

clinical operationalizationdelphidevelopmentemergencygeneral surgerymHealthmobile appmobile healthmorbiditymultimorbidityqualifying comorbidity setsurgeryusability

Identifiers

PMID37440310
PMCPMC10375392

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.