LoL Architecture Dynamically Reorders Transformer Layers at Inference

Library of Layers (LoL) introduces an architecture that adaptively orders transformer blocks during runtime. It allows a single model to transition between parameter reuse and sparsity, unifying dense, recurrent, and MoE architectures through a single hyperparameter.