FlexEE Framework for Offloading-Aware LLM Early Exiting

FlexEE optimizes LLM inference in memory-constrained environments by using layer-wise exit supervision and self-speculative decoding over a Top-K local vocabulary. It achieves speedups of up to 3.16x by enabling early exiting that maintains KV-cache compatibility during weight offloading.