Neologism Inoculation Prompting Secures Models Against Reward Hacking

Neologism Inoculation Prompting (NIP) reduces undesired model behaviors by replacing plain-English inoculation prompts with a specialized, single token trained on a frozen model. NIP outperforms standard inoculation methods and matches gradient routing performance in preventing reward hacking by hiding harmful behaviors in unreachable input regions.