RefactorProof: Evaluating LLM Code Proof Stability Under Program Refactoring
October 28, 2026
The RefactorProof benchmark tests whether LLM-generated proofs remain valid after non-functional code refactoring. Results show significant brittleness, with task-normalized structural survival as low as 4.3% for reference proofs and 13.3-26.8% for specialized provers like DeepSeek-Prover-V2-7B.
HOW THIS AFFECTS YOU
●
researcherYou should account for structural brittleness when evaluating verifiable code generation models.