Evidence map›Paper›PMID 37460815›Full record

ArticleSurgical endoscopy2023

CUSUM learning curves: what they can and can't tell us.

Peng-Lin Lin, Feibi Zheng, Minkyung Shin, Xi Liu, Daniel Oh, Daniel D'Attilio

Open access · hybridAbstract read
In one paragraph

Article in Surgical endoscopy, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 50 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
50citing papers in PubMed, 2 pooled it
15.8field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

50 citing papers in PubMed, 2 syntheses or guidelines pooled it, 72 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. How many cases to proficiency? A systematic review of the learning curve in endoscopic lumbar interbody fusion.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Review
  13. Article
  14. Designing self-assessment tools for learning five instrumental clinical procedures in ENT: A modified Delphi consensus approach.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  15. Article
  16. Observational
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 2 countries.

Peng-Lin LinIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA. Penglin.Lin@intusurg.com.ORCID http://orcid.org/0009-0009-8794-3573
Feibi ZhengIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA.
Minkyung ShinIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA.
Xi LiuIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA.
Daniel OhIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA.
Daniel D'AttilioIntuitive Surgical, 1020 Kifer Road, Sunnyvale, CA, 94086-5304, USA.
Intuitive Surgical (United States) · USIntuitive Surgical (Switzerland) · CH

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThere has been increased interest in assessing the surgeon learning curve for new skill acquisition. While there is no consensus around the best methodology, one of the most frequently used learning curve assessments in the surgical literature is the cumulative sum curve (CUSUM) of operative time. To demonstrate the limitations of this methodology, we assessed the CUSUM of console time across cohorts of surgeons with differing case acquisition rates while varying the total number of cases used to calculate the CUSUM.

methodsWe compared the CUSUM curves of the average console times of surgeons who completed their first 20 robotic-assisted (RAS) cases in 13, 26, 39, and 52 weeks, respectively, for their first 50 and 100 cases, respectively. This analysis was performed for prostatectomy (1094 surgeons), malignant hysterectomy (737 surgeons), and inguinal hernia (1486 surgeons).

resultsIn all procedures, the CUSUM curve of the cohort of surgeons who completed their first 20 procedures in 13 weeks demonstrated a lower slope than cohorts of surgeons with slower case acquisition rates. The case number at which the peak of the CUSUM curve occurs uniformly increases when the total number of cases used in generation of the CUSUM chart changes from 50 to 100 cases.

conclusionThe CUSUM analyses of these three procedures suggests that surgeons with fast initial case acquisition rates have less variability in their operative times over the course of their learning curve. The peak of the CUSUM curve, which is often used in surgical learning curve literature to denote "proficiency" is predictably influenced by the total number of procedures evaluated, suggesting that defining the peak as the point at which a surgeon has overcome the learning curve is subject to routine bias. The CUSUM peak, by itself, is an insufficient measure of "conquering the learning curve."

Indexed as

LaparoscopyRobotic Surgical ProceduresFemaleHumansLearning CurveMaleOperative TimeRetrospective StudiesConsole timeCUSUMLearning curveRobotic-assisted surgery

Identifiers

PMID37460815
PMCPMC10520215
OpenAlexW4384561785

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.