학술논문

Lambda Attention Branch Networksによる視覚的説明生成 / Visual Explanation Generation Based on Lambda Attention Branch Networks
Document Type
Journal Article
Source
Proceedings of the Annual Conference of JSAI. 2022, :2
Subject
Attention Branch
Lambda Networks
Visual Explanation Generation
transformer
視覚的説明生成
Language
Japanese
Abstract
Explanation generation for transformers enhances accountability for their predictions. However, there have been few studies on generating visual explanations for the transformers that use multidimensional context, such as LambdaNetworks. In this paper, we propose the Lambda Attention Branch Networks, which attend to important regions in detail and generate easily interpretable visual explanations. We also propose the Patch Insertion-Deletion score, an extension of the Insertion-Deletion score, as an effective evaluation metric for images with sparse important regions. Experimental results on two public datasets indicate that the proposed method successfully generates visual explanations.

Online Access