SOURCE-LINKED INTELLIGENCE

A JEPA Recipe for Tabular Foundation Models

arXiv · AI, language, vision and robotics · article · Sep 22, 2026 · UTC

Tabular foundation models learn to predict cell values in context, whereas world-model self-supervision asks for prediction in representation space (LeCun, 2022; Assran et al., 2023). On a tabular foundation-model prior, the latent term of a joint-embedding predictive architecture (JEPA) collapsed in our earlier runs and took the encoder with it to a constant map. We report a recipe under which the latent term survives to convergence beside the value objective: the value head reads the encoder field rather than the predictor, and the target is an exponential moving average (EMA) difference. To

Read original source ↗ Open in workspace

recordType

paper

region

Global