RATED Increases Tool Retrieval MRR by 52.2% via Execution Feedback
October 12, 2026
RATED combines dual-encoder semantic matching with a contextual bandit module to re-rank tools based on real-time execution success. Tested on the new EcoAgent benchmark, the framework adapts to runtime tool failures without requiring expensive model retraining.
HOW THIS AFFECTS YOU
●
builderYou can implement more reliable tool-calling agents by using real-time feedback to bypass failing APIs.
●
founderThis provides a path to building highly reliable autonomous agents in complex, real-world tool environments.