SOURCE-LINKED INTELLIGENCE

A Semiotics-Aware Framework for Evaluating Fidelity and Coverage in Natural Language Generation

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

When two texts describe the same expression, standard metrics based on lexical overlap or whole-text similarity may fail to detect meaningful differences in how that expression is framed. We propose a framework to evaluate semiotic alignment between texts, where a semiotic profile encompasses both the contextual meaning and the discourse references made salient by a text. Our approach yields two scores, Semiotic Fidelity and Semiotic Coverage, estimating how much of one text's profile is supported by the other and how much of the other's profile it recovers. Experiments show that coverage is t

Read original source ↗ Open in workspace

recordType

paper

region

Global