Biological Context Failure in LLM-Guided Experimental Optimization

In 45 reconstructed biology tasks, domain-agnostic prompts outperformed domain-aware prompts in 58.7% of trajectories when using LLMs for closed-loop optimization. The study suggests that providing meaningful biological labels and units does not reliably improve LLM performance over randomized equivalents in experimental design.