AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Omni2Web: Benchmarking Audiovisual Website Development

arXiv · AI, language, vision and robotics · article · Sep 20, 2026 · UTC

Screen-recorded web editing requests contain weak deictic expressions such as ``this'' and ``there,'' whose referents depend on speech, cursor trajectories, page state, and edit history. Such requests require intent recovery beyond the explicit specifications assumed by many existing web-editing benchmarks. We introduce Omni2Web, a bilingual benchmark of 918 instances spanning 13,907 edit steps. It defines three complementary tracks: Direct Editing evaluates webpage editing from recordings, Instruction Recovery measures explicit intent recovery, and Instruction Utility tests whether recovered

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-23T10:01:48.231Z. This is not the publication date.