[arXiv]score: 0.16

RL Tool-Use in Qwen2.5-3B Traced to Single Crosscoder Feature

June 26, 2026

Tool-calling behavior in Qwen2.5-3B after RL fine-tuning localizes to a compact set of features identifiable via Dedicated Feature Crosscoders, with encode-decode reconstruction boosting tool correctness by +31.1pp and passively transferring capability to the frozen base model by +6.8pp. The capability spillover finding suggests RL-induced behaviors can be isolated and transplanted without retraining, opening paths for retraining-free behavioral control.

HOW THIS AFFECTS YOU

●

builderCapability spillover means you may be able to transfer RL-trained tool-use behaviors to a frozen base model without additional fine-tuning, potentially reducing compute costs for agentic deployments.

●

researcherDFC partitioning offers a concrete mechanistic handle on how RL reshapes representations, with a 48-crosscoder sweep providing reproducible methodology for isolating capability-specific features.

read original ↗arxiv.org

← back to feed