SOURCE-LINKED INTELLIGENCE

GAPS: Dimension-Level Gates for Conditional Activation Steering

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Activation steering suppresses undesired behaviors in language models by adding a steering vector to the hidden state during generation. Recent conditional methods such as CAST and DSAS improve the behavior-capability trade-off by deciding when to intervene, but once active, they apply the full dense vector to all hidden dimensions, regardless of whether a neuron carries concept information or already lies in the desired regime. We introduce dimension-level conditioning as a complementary axis of selectivity that also decides which neurons to intervene on. Our method, GAPS (Gated Activation st

Read original source ↗ Open in workspace

recordType

paper

region

Global