Fine-tuning on OpenHands trajectories causes performance degradation in other CLI scaffolds
August 5, 2026
Models fine-tuned on OpenHands trajectory datasets show significant performance loss when deployed in non-training scaffolds. This divergence is caused by the model internalizing scaffold-specific planning structures rather than general reasoning, specifically regarding explicit and implicit planning conventions.
HOW THIS AFFECTS YOU
●
builderAvoid over-optimizing agents on a single training environment if you plan to deploy on different execution frameworks.
●
researcherYou should account for scaffold-specific bias when evaluating agentic fine-tuning.