Logo image
Global Feature Attribution Map based on Optical Flow for Super Resolution Neural Networks
Conference proceeding   Peer reviewed

Global Feature Attribution Map based on Optical Flow for Super Resolution Neural Networks

Xiaochen Liu, A Jacob, W Song and Antonio Liotta
2024 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2024, pp.141-148
2024 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) (Sharjah, 16/12/2024–19/12/2024)
2024
Handle:
https://hdl.handle.net/10863/51232

Abstract

Data-driven Artificial Intelligence (D2AI) super-resolution Attribution map Deep neural networks Optical flow
Research in image super-resolution (SR), which seeks to enhance image quality by producing higher-resolution versions from low-quality inputs, has primarily focused on developing reconstruction algorithms rather than enhancing interpretability. SR networks continue to exhibit the opaque, black-box characteristics typical of deep learning, with limited research dedicated to investigating their internal mechanisms. This study aims to deepen the understanding of SR and conduct attribution analysis of SR networks from a holistic reconstruction perspective. We introduce a novel attribution method based on gradient and optical flow, termed GOFlow. Following verification with five SR models, we demonstrate that (1) GOFlow proves to be an effective tool for analyzing attributed pixels in SR neural networks from a comprehensive perspective; (2) Compared to the Layer Attribution Method (LAM), GOFlow produces a more detailed attribution map from a global perspective; (3) GOFlow is capable of exploring how texture and colorfulness influence the outputs of SR, proving that GOFlow can interpret SR models at the feature level.
url
https://doi.org/10.1109/BDCAT63179.2024.00033View

Details

Metrics

1 Record Views
Logo image