●builderYou should not rely on model confidence scores as a proxy for knowledge boundaries in production decision systems.
●policyThis highlights risks in deploying black-box models for automated decision-making where overconfidence in unknown domains is prevalent.