Train-Then-Fix RL Deployment Is Structurally Wrong, Paper Argues

Deployed RL agents face four sources of non-stationarity that make the train-then-fix paradigm insufficient; the paper argues any agent receiving a reward signal post-deployment is inherently a continual RL problem and should never stop adapting.