Learning and Forgetting

by allenlu2007

Somehow learning missing a factor of forgetting.


Forgetting help learning?  or just time adaptive process?  or to save storage?


What’s the mechanism of forgetting?  time varying weight? 

or break the recurrent network?  or others?  


Forgetting help learning?  in a dream?  How to explain it in neural network?


Cricket proposed an explanation of dream.  

It models the brain as a Hopfield model.  The equivalent memory is not optimized when there exists deep energy minimum.   By unlearning something can increase the total memory.