AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Evaluating Open-Weight LLMs for Turkish Domain Documents Under Retrieval and Hardware Constraints

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Most Turkish-capable large language models (LLMs) are evaluated using general-purpose benchmarks rather than long, structurally complex domain documents. This paper evaluates five open-weight 7B-8B models for Turkish document question answering under a resource-constrained local deployment setting. The primary benchmark contains 100 systematically validated questions derived from a 109-page industrial R&D report, and the evaluation protocol is replicated using a second 112-page public-sector report and an independently constructed 100-question set. All models are evaluated locally on an NVIDIA

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-24T01:22:21.678Z. This is not the publication date.