SOURCE-LINKED INTELLIGENCE

Automatic multimodal UX improvement recommendations from LLM agent user simulations

arXiv · AI, language, vision and robotics · article · Sep 19, 2026 · UTC

Evaluating user experience (UX) on live websites through user testing is expensive, subjective, and difficult to scale. LLM agents offer a promising route to automating UX testing by simulating realistic user behaviour. However, existing simulation approaches typically lack multimodality and require time-consuming manual review to extract actionable insights. We formalise UX improvement recommendation from simulation data as a structured natural language generation and ranking problem, and establish an evaluation protocol using expert annotation and LLM-as-a-Judge. We present AMUSER, a multimo

Read original source ↗ Open in workspace

recordType

paper

region

Global