rTaste Evaluates Research Agent Judgment and Experiment Forecasting

The rTaste framework tests whether frontier models can identify valuable Minimum Viable Experiments (MVEs) in NLP research. While agents outperform random selection in ranking experiment value, they struggle to select non-obvious experiments beyond the seed paper.