SOURCE-LINKED INTELLIGENCE

Faithful Faithfulness Evaluations: Challenges & Pitfalls Learned from a Breast MRI Case Study

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Saliency maps are widely used to explain deep learning predictions in medical imaging, yet visually plausible explanations do not necessarily reflect a model's true decision process and may therefore mislead clinicians. We investigate this problem using a Vision Transformer-based breast MRI classifier trained on the ODELIA Breast MRI Challenge dataset and evaluate multiple saliency methods, including Last-layer Attention, Attention Rollout, Grad-SAM, Gradient Attention Rollout, GMAR, Grad-CAM, and HiResCAM. Our study highlights two often-overlooked challenges in perturbation-based faithfulness

Read original source ↗ Open in workspace

recordType

paper

region

Global