SOURCE-LINKED INTELLIGENCE

Seeing Through Extreme Visual Sparsity: Surface Understanding from a Single Random Visual Patch

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Surface material recognition from incomplete visual observations remains a challenging problem in robotic perception and environmental understanding. This paper discusses Sparse Surface Understanding Framework (SSUF), a unified dual-task learning framework that adapts four pretrained architectures-Convolutional Autoencoder (ConvAE), Vision Transformer (ViT), Swin Transformer, and Masked Autoencoder (MAE) for si-multaneous surface reconstruction and material classification. Experiments were conducted on the Touch-and-Go dataset using a sparse observation protocol in which only 10% of the origin

Read original source ↗ Open in workspace

recordType

paper

region

Global