A Fair Objective for Human-Empowerment-Preserving AI: Desiderata, Design, and Likely Behavioral Consequences

This paper defines a decomposable objective function designed to maintain human agency by maximizing a risk-averse, long-term aggregate of human power. The framework incorporates bounded rationality and social norms to manage the power balance between agents and humans across diverse goal sets.