Wiola 13M Architecture Optimizes Parameter-Efficient Small Language Models
August 18, 2026
Wiola is a 13M parameter decoder-only model featuring Spiral Rotary Positional Encoding and Gated Spiral Attention. The architecture introduces a Butterfly feed-forward block to improve efficiency in the small-scale parameter regime.
HOW THIS AFFECTS YOU
●
builderThis architecture provides a path for more capable on-device inference.
●
researcherYou can leverage new attention and encoding mechanisms specifically designed for the sub-100M parameter scale.