2 items tagged
Hippo: Recurrent Memory with Optimal Polynomial Projection Motivation Hidden state in RNN represents a form of memory of the past. For a sequence, a natural way to represent the past sequence is to project it onto an orthonormal basis set. Here depending on the different emphasis of the past, we could define different measures on the time axis and define the basis set based on this measure. Then we can keep track of the projection coefficient on this basis when observing new data points.
Based on Goldstein Book Chapter and lecture from Jeff Beck Note on Forms of Memory Definition pin down can be very tricky! Definition Retaining, retrieving, using information after the original information (stimuli) does not present. (Inner view) Any process that some past experience has an effect on the way the subject think and behave in the future. (Outer View) Thus can generalize into even non-animated things! Memory of magnet Use of Memory Longterm Memory Human: Remember things relevant for life. (name, pw, birthday, info about others, address, knowledge) Ecological: cache for food, foraging location. Shorterm Memory Continuity of awareness Different forms Memory has many forms.