TreeWY: Memory-Efficient Speculative Verification for Gated DeltaNet Hybrids
August 24, 2026
TreeWY enables speculative decoding for Gated DeltaNet (GDN) hybrids by replacing per-node recurrent state snapshots with a single triangular solve. This allows wide draft trees to be verified without the memory overhead of storing full states for every branch.
HOW THIS AFFECTS YOU
●
builderYou can implement speculative decoding on linear-attention hybrids without the memory explosion of state snapshots.
●
researcherThis provides a way to scale speculative decoding to any architecture following the gated delta rule.