Soup allows fine-tuning large language models using a single YAML configuration. It utilizes layer streaming to enable training of 8B parameter models on hardware with as little as 4GB of VRAM.
HOW THIS AFFECTS YOU
●
builderYou can now fine-tune larger models on consumer-grade laptop hardware.
●
researcherThis simplifies the experimental loop for parameter-efficient fine-tuning on limited compute.