Evidence map›Paper›PMID 35904877›Full record

ArticleJMIR cancer2022

Providing Care Beyond Therapy Sessions With a Natural Language Processing-Based Recommender System That Identifies Cancer Patients Who Experience Psychosocial Challenges and Provides Self-care Support: Pilot Study.

Yvonne W Leung, Bomi Park, Rachel Heo, Achini Adikari, Suja Chackochan, Jiahui Wong, Elyse Alie, Mathew Gancarz, Martyna Kacala, Graeme Hirst and 7 more

Abstract read
In one paragraph

Article in JMIR cancer, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Yvonne W Leungde Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-3348-1547
Bomi Parkde Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-4538-3709
Rachel HeoThe Michael G DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada.ORCID https://orcid.org/0000-0003-3713-1365
Achini AdikariResearch Centre for Data Analytics and Cognition, LaTrobe University, Melbourne, Australia.ORCID https://orcid.org/0000-0001-5112-5063
Suja Chackochande Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-2933-5640
Jiahui Wongde Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-0369-2455
Elyse Aliede Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-1679-7379
Mathew Gancarzde Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-7922-057X
Martyna Kacalade Souza Institute, University Health Network, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-0037-3467
Graeme HirstDepartment of Computer Science, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0001-9482-1042
Daswin de SilvaResearch Centre for Data Analytics and Cognition, LaTrobe University, Melbourne, Australia.ORCID https://orcid.org/0000-0003-3878-5969
Leon FrenchDepartment of Psychiatry, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-9409-4583
Jacqueline BenderDepartment of Psychiatry, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-1501-335X
Faye MishnaFaculty of Social Work, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0003-2538-826X
David GratzerDepartment of Psychiatry, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-4578-0050
Damminda AlahakoonResearch Centre for Data Analytics and Cognition, LaTrobe University, Melbourne, Australia.ORCID https://orcid.org/0000-0003-3291-888X
Mary Jane EsplenDepartment of Psychiatry, University of Toronto, Toronto, ON, Canada.ORCID https://orcid.org/0000-0002-6034-2235

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe negative psychosocial impacts of cancer diagnoses and treatments are well documented. Virtual care has become an essential mode of care delivery during the COVID-19 pandemic, and online support groups (OSGs) have been shown to improve accessibility to psychosocial and supportive care. de Souza Institute offers CancerChatCanada, a therapist-led OSG service where sessions are monitored by an artificial intelligence-based co-facilitator (AICF). The AICF is equipped with a recommender system that uses natural language processing to tailor online resources to patients according to their psychosocial needs.

objectiveWe aimed to outline the development protocol and evaluate the AICF on its precision and recall in recommending resources to cancer OSG members.

methodsHuman input informed the design and evaluation of the AICF on its ability to (1) appropriately identify keywords indicating a psychosocial concern and (2) recommend the most appropriate online resource to the OSG member expressing each concern. Three rounds of human evaluation and algorithm improvement were performed iteratively.

resultsWe evaluated 7190 outputs and achieved a precision of 0.797, a recall of 0.981, and an F1 score of 0.880 by the third round of evaluation. Resources were recommended to 48 patients, and 25 (52%) accessed at least one resource. Of those who accessed the resources, 19 (75%) found them useful.

conclusionsThe preliminary findings suggest that the AICF can help provide tailored support for cancer OSG members with high precision, recall, and satisfaction. The AICF has undergone rigorous human evaluation, and the results provide much-needed evidence, while outlining potential strengths and weaknesses for future applications in supportive care.

Indexed as

artificial intelligencenatural language processingonline support groupsrecommender systemsupportive care in cancer

Identifiers

PMID35904877
PMCPMC9377447

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.