CNN Explanation Methods for Ordinal Regression Tasks

Research areas:

• Methodology - Ordinal classification

Year:

2024

Type of Publication:

Article

Keywords:

convolutional neural networks, explanation methods, ordinal regression

Authors:

• Barbero-Gómez, Javier
• Cruz, Ricardo P.M.
• Cardoso, Jaime S.
• Gutiérrez, Pedro Antonio
• Hervás-Martínez, César

Journal:

Neurocomputing

Volume:

Accepted on 6th November

ISSN:

0925-2312

BibTex:

@article{CNNJaviBarbero2024, author = "Javier Barbero-G{\'o}mez and Cruz, Ricardo P.M. and Cardoso, Jaime S. and Pedro Antonio Guti{\'e}rrez and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "The use of Convolutional Neural Network (CNN) models for image classification tasks has gained significant popularity. However, the lack of interpretability in CNN models poses challenges for debugging and validation. To address this issue, various explanation methods have been developed to provide insights into CNN models. This paper focuses on the validity of these explanation methods for ordinal regression tasks, where the classes have a predefined order relationship. Different modifications are proposed for two explanation methods to exploit the ordinal relationships between classes: Grad-CAM based on Ordinal Binary Decomposition (GradOBD-CAM) and Ordinal Information Bottleneck Analysis (OIBA). The performance of these modified methods is compared to existing popular alternatives. Experimental results demonstrate that GradOBD-CAM outperforms other methods in terms of interpretability for three out of four datasets, while OIBA achieves superior performance compared to IBA.", awards = "JCR(2023): 5.5, Position: 42/197 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", comments = "JCR(2023): 5.5, Position: 42/197 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", issn = "0925-2312", journal = "Neurocomputing", keywords = "convolutional neural networks, explanation methods, ordinal regression", note = "JCR(2023): 5.5, Position: 42/197 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE", title = "{CNN} {E}xplanation {M}ethods for {O}rdinal {R}egression {T}asks", volume = "Accepted on 6th November", year = "2024", }

Note:

JCR(2023): 5.5, Position: 42/197 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE

Abstract:

The use of Convolutional Neural Network (CNN) models for image classification tasks has gained significant popularity. However, the lack of interpretability in CNN models poses challenges for debugging and validation. To address this issue, various explanation methods have been developed to provide insights into CNN models. This paper focuses on the validity of these explanation methods for ordinal regression tasks, where the classes have a predefined order relationship. Different modifications are proposed for two explanation methods to exploit the ordinal relationships between classes: Grad-CAM based on Ordinal Binary Decomposition (GradOBD-CAM) and Ordinal Information Bottleneck Analysis (OIBA). The performance of these modified methods is compared to existing popular alternatives. Experimental results demonstrate that GradOBD-CAM outperforms other methods in terms of interpretability for three out of four datasets, while OIBA achieves superior performance compared to IBA.

Comments:

JCR(2023): 5.5, Position: 42/197 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE