Low Relation Extraction Performance in Aviation Accident Narratives
October 21, 2026
Evaluating a decomposed framework for aviation safety knowledge discovery shows significant performance degradation under relational sparsity. RoBERTa achieved a 0.4809 Macro-F1 during development but dropped to 0.2420 during exhaustive evaluation, struggling with the 1.18% prevalence of target relations.
HOW THIS AFFECTS YOU
●
researcherExpect difficulty when applying standard transformer models to sparse, domain-specific relation extraction tasks.