AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Deterministic Regime Switching and Feasibility Inversion in Dynamic Tensor Rematerialization

arXiv · AI, language, vision and robotics · article · Sep 25, 2026 · UTC

We report fine-grained, deterministic instability in Dynamic Tensor Rematerialization (DTR), an online eviction policy for memory-constrained DNN training, measured on the reference DTR simulator (simrd) using public execution traces. On an LSTM trace, memory budgets differing by 0.10% of unconstrained peak memory select fast and slow execution regimes whose overheads differ by as much as 7.3x; the slow regime is driven by broadly repeated re-eviction of the same storages (evictions per storage rise from 1.33 to 8.27 while the set of distinct evicted storages is essentially unchanged: 5,233 vs

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-28T07:21:24.486Z. This is not the publication date.