Task Operator Replays In-Context Learning via Affine Transformations

Task Operator (TO) optimizes in-context learning by treating attention head outputs as affine transformations of context-masked counterparts. This method allows for analytically derived updates to attention output projections, providing a more stable and efficient alternative to fixed activation vector compression.