Research

Small Models, Long Memory: Learned Forgetting for Efficient Long-Context Recall

Compact networks trained to forget the right things recall as well as models ten times their size.