Spurious Signal Routing in Tabular In-Context Learners

Research identifies that in-context learners like TabPFN struggle to distinguish between causal signals and spurious artifacts when they are bundled within the same feature. The study proves that for ridge in-context learners, this routing error is unavoidable regardless of the context size provided.