[r/LocalLLaMA]score: 0.21

Agens Volundr 32B uses hybrid KDA and BCSA architecture to reduce KV cache

October 5, 2026

Agens Volundr 32B utilizes a hybrid architecture where only 18 of 72 layers maintain a KV cache. The design employs 54 KDA linear attention layers with fixed-size recurrent states and 17 BCSA layers using 4:1 block pooling to optimize memory usage for long-context workloads.

HOW THIS AFFECTS YOU

●

builderYou can potentially run larger context windows on memory-constrained local hardware by bypassing standard KV cache scaling.

●

researcherThe combination of linear attention, sparse attention, and n-gram memory provides a novel architecture for testing memory-efficient long-context retrieval.

read original ↗v.redd.it

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed