TF-IDF Weighted Cross-Entropy for Reduced Model Memorization

This method rescales token-level contributions using TF-IDF statistics to emphasize semantically informative tokens. Applying this to TinyLLaMA 1.1B reduced substring memorization by 58% with less than 3% computational overhead.