Evidence map›Paper›PMID 36616728›Full record

ArticleSensors (Basel, Switzerland)2022

Understanding How CNNs Recognize Facial Expressions: A Case Study with LIME and CEM.

Guillermo Del Castillo Torres, Maria Francesca Roig-Maimó, Miquel Mascaró-Oliver, Esperança Amengual-Alcover, Ramon Mas-Sansó

Open access · goldAbstract read
In one paragraph

Article in Sensors (Basel, Switzerland), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
2.9field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it, 23 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Guillermo Del Castillo TorresDepartment of Mathematics and Computer Science, University of the Balearic Islands, 07122 Palma, Spain.
Maria Francesca Roig-MaimóDepartment of Mathematics and Computer Science, University of the Balearic Islands, 07122 Palma, Spain.ORCID 0000-0001-6040-6270
Miquel Mascaró-OliverDepartment of Mathematics and Computer Science, University of the Balearic Islands, 07122 Palma, Spain.ORCID 0000-0002-9719-0183
Esperança Amengual-AlcoverDepartment of Mathematics and Computer Science, University of the Balearic Islands, 07122 Palma, Spain.
Ramon Mas-SansóDepartment of Mathematics and Computer Science, University of the Balearic Islands, 07122 Palma, Spain.ORCID 0000-0002-7559-5163
Universitat de les Illes Balears · ES

Funding

Ministerio de Ciencia e Innovación PID2019-104829RA-I00 / MCIN/ AEI / 10.13039/501100011033
6 · The paper itself

Abstract

Recognizing facial expressions has been a persistent goal in the scientific community. Since the rise of artificial intelligence, convolutional neural networks (CNN) have become popular to recognize facial expressions, as images can be directly used as input. Current CNN models can achieve high recognition rates, but they give no clue about their reasoning process. Explainable artificial intelligence (XAI) has been developed as a means to help to interpret the results obtained by machine learning models. When dealing with images, one of the most-used XAI techniques is LIME. LIME highlights the areas of the image that contribute to a classification. As an alternative to LIME, the CEM method appeared, providing explanations in a way that is natural for human classification: besides highlighting what is sufficient to justify a classification, it also identifies what should be absent to maintain it and to distinguish it from another classification. This study presents the results of comparing LIME and CEM applied over complex images such as facial expression images. While CEM could be used to explain the results on images described with a reduced number of features, LIME would be the method of choice when dealing with images described with a huge number of features.

Indexed as

Artificial IntelligenceFacial ExpressionHumansMachine LearningNeural Networks, ComputerCEMconvolutional neural networksemotion recognitionfacial expression recognitionLIMEmachine learningUIBVFEDXAI

Identifiers

PMID36616728
PMCPMC9824600
OpenAlexW4312171814

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.