Skill Neologisms for Continual Learning Without Weight Updates

This method introduces skill neologisms, which are soft tokens integrated into a model's vocabulary to acquire new capabilities. This approach enables selective skill acquisition and composition without the catastrophic forgetting associated with fine-tuning or the context constraints of in-context learning.