UniSpark-9B Uses Hybrid Attention for Multimodal Tasks
November 11, 2026
UniSpark-9B is a 9B parameter Mixture-of-Transformer-Experts model that combines full attention with GatedDeltaNet linear attention. It supports interleaved text-image generation, visual question answering, and instruction-guided editing.
HOW THIS AFFECTS YOU
●
builderYou can use this model for complex tasks that require both visual understanding and interleaved generation.
●
researcherYou can combine full attention for token interaction with linear attention for compact context propagation.