How memorization happens: Repetition
Posted on Di 03 Dezember 2024 in ml-memorization
In this article in the deep learning memorization series, you'll learn how one part of memorization happens -- highly repeated data from the "head" of the long-tailed distribution.
Recall from the data collection article that some examples are overrepresented in the dataset. They live in the "head" area and might be …
Continue reading