SOURCE-LINKED INTELLIGENCE

REAL-Q: E2E LLM Quantization via Dynamic Gradient Descent

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Post-training quantization (PTQ) is essential for deploying large language models (LLMs) under strict resource constraints. State-of-the-art PTQ methods quantize each layer with a single closed-form second-order solver: to remain analytically tractable, they heavily approximate the global loss (dropping cross-channel coupling, pooling output rows into groups), and they then freeze the resulting Hessian across the entire layer, with no way to refresh it as the loss landscape shifts column by column--a phenomenon we call information misalignment. We propose REAL-Q (Real-time E2E-loss Aligned LLM

Read original source ↗ Open in workspace

recordType

paper

region

Global