SOURCE-LINKED INTELLIGENCE

Predicting Quantization Price for Selecting PTQ Configurations Before Deployment

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Weight-space post-training quantization (PTQ) must choose finite formats, granularities, quantizer families, transformations, and bits before the completed quantized model reveals its output-distribution drift. Existing PTQ methods predict important pieces of this degradation, including reconstruction error, Hessian sensitivity, transformation effects, and downstream loss, but these pieces are usually scored after fixing the quantization geometry or inside separate configuration families. We formulate weight-space PTQ as pre-deployment configuration selection using priced layer-output error. E

Read original source ↗ Open in workspace

recordType

paper

region

Global