Competence-Based Evaluation Paradigm for LLM Logical Reasoning

To address LLM reasoning inconsistencies, this paper proposes Competence-Based Evaluation (CBE), which tests a model's ability to apply reasoning across a parameterized family of problems rather than single accuracy scores.