SOURCE-LINKED INTELLIGENCE

Quantization Effects on Bangla Language Understanding in Large Language Models: A Systematic Evaluation

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

Post-training quantization lowers the memory footprint of Large Language Models (LLMs) and speeds up inference, which is why it is now common for on-device deployment. Most of what we know about its effects, however, comes from English benchmarks. It is not clear whether the same holds for morphologically complex, low-resource languages such as Bangla, and this gap is what we address here. We evaluate three model families---Qwen-2.5-7B, LLaMA-3.1-8B, and GPT-OSS-20B---in full precision and in three quantized formats (GPTQ-Int8, GPTQ-Q8, GGUF-W8A16) across five Bangla natural language understan

Read original source ↗ Open in workspace

recordType

paper

region

Global