SOURCE-LINKED INTELLIGENCE

Iterative Atom Refinement: A Monotonicity Principle for Dictionary Learning

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Dictionary learning seeks to recover an unknown dictionary $A$ from observations ${\bf y}_i = A{\bf x}_i$ with sparse coefficient vectors ${\bf x}_i$. We introduce the \emph{Iterative Atom Refinement} (IAR) algorithm, a simple procedure for recovering individual dictionary atoms. Starting from a random direction, IAR repeatedly selects the observations most strongly correlated with the current iterate and updates the direction by averaging the selected data. Our main contribution is a rigorous convergence theory of IAR. Using high-dimensional probabilistic estimates and a novel monotonicity pr

Read original source ↗ Open in workspace

recordType

paper

region

Global