SOURCE-LINKED INTELLIGENCE

Sparse Regression Distilled from a Single Robust Fit

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Robust linear fits can resist response contamination yet remain too dense or unstable for useful global explanations. We propose penalized distillation, which fits a smoothly clipped absolute deviation (SCAD) estimator to a robust initial estimator's empirical fitted surface along a safeguarded coordinate-descent path and evaluates candidate states separately for fidelity, parsimony, perturbation stability, and held-out prediction. The new results attach to the states the algorithm actually computes. Conditional on a fixed uncontaminated design, deterministic bounds transfer response-replaceme

Read original source ↗ Open in workspace

recordType

paper

region

Global