MemToC Benchmark Reveals LLM Failure in Tool-Memory Conflict Resolution

The MemToC benchmark evaluates how 7-9B models handle conflicts between parametric memory and tool returns. Instruction-tuned models correctly prioritized accurate tool returns over incorrect internal memory in only 6.5-17.1% of cases, though they successfully followed correct tools 86.0-93.1% of the time.