DeoGen Automates Deontic Reasoning Benchmarks via First-Order Logic

DeoGen uses autoformalization of policy rules into first-order logic to automatically generate scalable deontic reasoning benchmarks. The framework constructs decision trees to create combinatorial entries that test a model's ability to apply rules and abstain when information is insufficient.