BRIE Framework Provides Automated Benchmarking for EHR Information Retrieval

The BRIE framework automatically generates question-answer pairs from longitudinal electronic health record notes to create a continuously maintainable evaluation dataset. Testing across nine LLMs shows current state-of-the-art systems frequently fail to synthesize clinically important information across multiple patient encounters.