
Small Models, Long Memory: learned forgetting for efficient long-context recall
Compact networks trained to forget the right things recall as well as models ten times their size.

Compact networks trained to forget the right things recall as well as models ten times their size.