Evidence map›Paper›PMID 39825768›Full record

ArticleUnited European gastroenterology journal2025

Inter-Rater Disagreements in Applying the Montreal Classification for Crohn's Disease: The Five-Nations Survey Study.

Offir Ukashi, Aurelien Amiot, David Laharie, Luis Menchén, Ana Gutiérrez, Samuel Fernandes, Tommaso Pessarelli, Fábio Correia, Carlos Gonzalez-Muñoza, Julia López-Cardona and 35 more

Abstract read
In one paragraph

Article in United European gastroenterology journal, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

45 authors.

Offir UkashiSheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.ORCID 0000-0002-8601-6550
Aurelien AmiotDepartment of Gastroenterology, Hopitaux Universitaires Bicêtre, AP-HP, Université Paris Saclay, INSERM U1018 CESP, Le Kremlin Bicêtre, France.
David LaharieCHU de Bordeaux, Centre Medico-Chirurgical Magellan, Gastroenterology Department, Hôpital Haut-Lévêque, Université de Bordeaux, INSERM CIC 1401, Bordeaux, France.
Luis MenchénHospital General Universitario - Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain.
Ana GutiérrezGastroenterology Department Hospital General Universitario Dr Balmis of Alicante, ISABIAL, Centro de Investigación Biomédica en Red en Enfermedades Hepáticas y Digestivas (CIBERehd), Alicante, Spain.
Samuel FernandesGastroenterology and Hepatology Department, Unidade Local de Saúde Santa Maria, Lisbon, Portugal.ORCID 0000-0002-2947-8791
Tommaso PessarelliDepartment of Pathophysiology and Transplantation, University of Milan, Milan, Italy.ORCID 0000-0002-8817-144X
Fábio CorreiaGastroenterology Department, Prof. Dr. Fernando Fonseca Hospital, Amadora, Portugal.ORCID 0000-0001-6395-3405
Carlos Gonzalez-MuñozaH. Santa Creu i Sant Pau (Gastroenterology Department), Barcelona, Spain.ORCID 0000-0003-0164-3449
Julia López-CardonaGastroenterology and Hepatology Department, University Hospital Ramon y Cajal, Madrid, Spain.
Giulio CalabreseGastroenterology Unit, Clinical Medicine and Surgery Department, University of Naples Federico II, Naples, Italy.
Rocio Ferreiro-IglesiasGastroenterology Department Hospital Universitario de Santiago de Compostela, A Coruña, Spain.ORCID 0000-0002-0469-4332
Natalie Tamir-DegabliFaculty of Medical and Health Sciences, Tel-Aviv University, Tel-Aviv, Israel.
Nikolas Konstantine DussiasIBD Unit, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy.
Amjad MousaGastroenterology Department, Bnai Zion Medical Center, Haifa, Israel.
Raquel OliveiraGastroenterology Department, Unidade Local de Saúde do Algarve, Portimão, Portugal.ORCID 0000-0002-3818-981X
Nicolas Richard"Nutrition, Inflammation, and Microbiota-Gut-Brain Axis," CHU Rouen, Department of Gastroenterology, University of Rouen Normandie, INSERM, Normandie University, ADEN UMR1073, Rouen, France.
Ido VeismanSheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.
Kassem SharifSheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.ORCID 0000-0003-3905-3313
Shomron Ben-HorinSheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.ORCID 0009-0001-1586-6056
Carlos Soutullo-CastiñeirasGastrointestinal Endoscopy Research Group, Health Research Institute Hospital La Fe (IISLaFe), Valencia, Spain.ORCID 0000-0003-3244-563X
Gabriele DragoniIBD Referral Centre, Clinical Gastroenterology Unit, Careggi University Hospital, Florence, Italy.
Silvia RotuloDepartment of Maternal and Child Health, Pediatric Gastroenterology and Liver Unit, Umberto I Hospital, Sapienza University of Rome, Rome, Italy.
Agnese FavaleDepartment of Medical Science and Public Health, University of Cagliari, Cagliari, Italy.ORCID 0000-0003-4508-4685
Louis CalméjaneUniversité Paris Cité, Paris, France.ORCID 0000-0002-3368-5814
Thomas BazinDepartment of Gastroenterology and Nutritional Support, Center for Intestinal Failure, Reference Centre of Rare Disease MarDI, Assistance Publique-Hôpitaux de Paris (AP-HP) Beaujon Hospital, University Paris Cité, Clichy, France.
Alfonso ElosuaGastroenterology Department, Hospital Universitario de Navarra, IdiSNA, Navarra Institute for Health Research, Pamplona, Spain.ORCID 0000-0001-6097-7612
Sara LopesUnidade Local de Saúde da Arrábida, Setúbal, Portugal.ORCID 0009-0009-6207-7437
Carla FeliceDepartment of Medicine, University of Padova, Padova, Italy.
Violeta MaurizGastroenterology Department Hospital Universitario de Santiago de Compostela, A Coruña, Spain.ORCID 0000-0002-7169-5087
Inês Coelho RodriguesGastroenterology and Hepatology Department, Unidade Local de Saúde Santa Maria, Lisbon, Portugal.
Julia JougonHepatogastroenterology Department, University of Lille, Lille, France.
Inês BottoGastroenterology and Hepatology Department, Unidade Local de Saúde Santa Maria, Lisbon, Portugal.
Helena Tavares de SousaGastroenterology Department, Unidade Local de Saúde do Algarve, Portimão, Portugal.ORCID 0000-0002-6626-205X
Lorenzo BertaniTuscany North West ASL, Department of Internal Medicine, Pontedera Hospital, Pontedera, Italy.ORCID 0000-0001-8653-1790
Paula Ripoll AbadíaGastroenterology, Hospital Universitario y Politécnico La Fe, Valencia, Spain.
Alice De BernardiIBD Center, Gastroenterology Unit, Rho Hospital, ASST Rhodense, Rho, Italy.
Yamile ZabanaHospital Universitari Mútua Terrassa and Centro de Investigación Biomédica en Red en Enfermedades Hepáticas y Digestivas (CIBERehd), Terrassa, Spain.ORCID 0000-0003-4023-8868
Xavier Serra-RuizCrohn's and Colitis Unit, Gastroenterology Department, Hospital Universitari Vall d'Hebron, Barcelona, Spain.
Anna ViolaIBD-Unit, Department of Clinical and Experimental Medicine, University of Messina, Messina, Italy.ORCID 0000-0002-1733-6489
Manuel Barreiro-de AcostaGastroenterology Department Hospital Universitario de Santiago de Compostela, A Coruña, Spain.ORCID 0000-0001-5915-1477
Henit YanaiFaculty of Medical and Health Sciences, Tel-Aviv University, Tel-Aviv, Israel.ORCID 0000-0001-5483-5271
Alessandro ArmuzziIBD Center, IRCCS Humanitas Research Hospital, Milan, Italy.
Fernando MagroCINTESIS@RISE, Faculty of Medicine, The University of Porto, Porto, Portugal.
Uri KopylovSheba Medical Center, Institute of Gastroenterology, Ramat-Gan, Israel.ORCID 0000-0002-7156-0588

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe Montreal classification has been widely used in Crohn's disease since 2005 to categorize patients by the age of onset (A), disease location (L), behavior (B), and upper gastrointestinal tract and perianal involvement. With evolving management paradigms in Crohn's disease, we aimed to assess the performance of gastroenterologists in applying the Montreal classification.

methodsAn online survey was conducted among participants at an international educational conference on inflammatory bowel diseases. Participants classified 20 theoretical Crohn's disease cases using the Montreal classification. Agreement rates with the inflammatory bowel diseases board (three expert gastroenterologists whose consensus rating was considered the gold standard) were calculated for gastroenterologist specialists and fellows/specialists with ≤ 2 years of clinical experience. A majority vote < 75% among participants was considered a notable disagreement. The same cases were classified using three large language models (LLMs), ChatGPT-4, Claude-3, and Gemini-1.5, and assessed for agreement with the board and gastroenterologists. Fleiss Kappa was used to assess within-group agreement.

resultsThirty-eight participants from five countries completed the survey. In defining the Montreal classification as a whole, specialists (21/38 [55%]) had a higher agreement rate with the board compared to fellows/young specialists (17/38 [45%]) (58% vs. 49%, p = 0.012) and to LLMs (58% vs. 18%, p < 0.001). Disease behavior classification was the most challenging, with 76% agreement among specialists and fellows/young specialists and 48% among LLMs compared to the inflammatory bowel diseases board. Regarding disease behavior, within-group agreement was moderate (specialists: k = 0.522, fellows/young specialists: k = 0.532, LLMs: k = 0.577; p < 0.001 for all). Notable points of disagreement included: defining disease behavior concerning obstructive symptoms, assessing disease extent via video capsule endoscopy, and evaluating treatment-related reversibility of the disease phenotype.

conclusionsThere is significant inter-rater disagreement in applying the Montreal classification, particularly for disease behavior in Crohn's disease. Improved education or revisions to phenotype criteria may be needed to enhance consensus on the Montreal classification.

Indexed as

Crohn DiseaseGastroenterologistsGastroenterologyAdultAge of OnsetConsensusFemaleHumansMaleObserver VariationSeverity of Illness IndexSurveys and Questionnairescomplicated disease phenotypeCrohn's diseaseinflammatory bowel diseaseslarge language modelsmontreal classification

Identifiers

PMID39825768
PMCPMC12188366

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.