Discussions suggest a shift in model development where labs are increasingly focusing on weights above 24B parameters, leading to a scarcity of state-of-the-art models under 15B.
HOW THIS AFFECTS YOU
●
founderThe lack of high-performing small models may create an opportunity for those specializing in efficient fine-tuning.
●
investorWatch for whether this trend limits the availability of edge-compatible SOTA models.