MIOE Benchmark Evaluates LLM Ontological Understanding via Mechanistic Interpretability
October 30, 2026
MIOE introduces a causal-abstraction benchmark using interchange interventions to test entity typing and subsumption prediction in Qwen3-4B and 8B models. Results show distributed subspace methods best preserve class-specific auxiliary information while altering ontology-level targets.
HOW THIS AFFECTS YOU
●
researcherYou can use this framework to move beyond behavioral correctness and probe how models internalize hierarchical knowledge structures.