Memory Dial Framework Gives Researchers Control Over Language Model Memorization

Researchers introduced Memory Dial, a training framework that isolates and controls memorization in language models through a single parameter, enabling systematic study of when and what AI systems memorize. The approach reveals larger models are more susceptible to memorization pressure and frequent sequences memorize easier than rare ones, advancing understanding of model behavior critical for AI safety and interpretability.