LoRA Fine-Tuning Improves SLM Retrieval Control Accuracy
September 25, 2026
Fine-tuning Granite 4.1 3B on 13,194 actions using LoRA achieves a macro-F1 of 0.6536 for predicting next retrieval actions in RAG workflows. This significantly outperforms zero-shot prompting (0.1736) and TF-IDF logistic-regression baselines (0.5399) for small language model controllers.
HOW THIS AFFECTS YOU
●
builderYou can use trajectory fine-tuning to turn small models into effective RAG controllers.
●
researcherThis demonstrates the efficacy of LoRA-supervised fine-tuning for structured action prediction in SLMs.