DASA optimizes fine-tuning via continuous synthetic input embeddings
September 30, 2026
DASA uses activation-gradient feedback from a frozen reference model to optimize continuous synthetic embeddings for fine-tuning. This method targets useful adaptation updates for Llama and Qwen models (1B to 32B) without requiring human-readable text or linguistic fluency.
HOW THIS AFFECTS YOU
●
builderThis provides a path to fine-tuning models using non-discrete, optimized embeddings.
●
researcherYou can explore non-textual training representations to improve adaptation utility.