Based on Goldstein Book Chapter and lecture from Jeff Beck Note on Forms of Memory Definition pin down can be very tricky! Definition Retaining, retrieving, using information after the original information (stimuli) does not present. (Inner view) Any process that some past experience has an effect on the way the subject think and behave in the future. (Outer View) Thus can generalize into even non-animated things! Memory of magnet Use of Memory Longterm Memory Human: Remember things relevant for life. (name, pw, birthday, info about others, address, knowledge) Ecological: cache for food, foraging location. Shorterm Memory Continuity of awareness Different forms Memory has many forms.
Oct 1, 2019
Informative Fragment Approach to Object Recognition It’s intuitive that some basic features in the image of objects are informative to the category of the object. Thus, even for occluded images, the revealed fragments can also provide such information, so that we could recognize the object from few patches.
Sep 25, 2019
Note on Feature Visualization Motivation We want to understand what the hidden units “represent” What are they tuned to? What’s the favorite stimuli? Why should we find the most excitable stimuli? Resources DeepDream.ipynb Tensorflow
Sep 17, 2019
Deep Unsupervised Learning Lecture notes from Berkeley-cs294 https://sites.google.com/view/berkeley-cs294-158-sp19/home Lec 1 Category Generative Model Non-generative representation learning Motivation for Unsupervised Learning Application Generate/predict fancy samples Detect Anomaly / deviation from distribution Which human can do quite well without training Data Compression (because of predictability) Use the inner representation to do other tasks! Pre-training Type of Question Core Question: Modeling a Distribution
Sep 13, 2019
Note on Animal Perception From lecture of Science of Behavior What does it feel to be a bat!? Umwelt: the sensory world of an animal, can be very different from ours. Different precision, range … Use same modality in different ways: Sound Imaging Electro-/Magneto-reception “More extreme your claim, stronger your evidence!”
Sep 12, 2019
Note on Computer Vision Lecture Notes from CS559. TOC {:toc} Lec01: Image Formation In principle, digital images are formed by measuring energy (counting photons) over an array. But several pre-processing steps makes it interesting and relevant to processing.
Sep 10, 2019
Note on Behavioral Study History of Behavioral Science Two historical trends of study combines into modern comparative cognition / behavioral science study. Comparative Psychology More in context of psychology: Athropocentric
Aug 28, 2019
Note on Network Commnunication TOC {:toc} General Introduction Network connects devices to transfer data / information. LAN and WAN LAN: Localized network, connected machines in the same area. WAN: Wide area, Internet is the largest WAN! The 2 types are less distinct now, they are blurred because of cellular tech and wireless network.
Jul 30, 2019
Note on Selective Attention From Christofer Koch 2013 Lecture Visual Attention and Consciousness Goldstein, Chapter Attention In nature language Attention refers to a family of abilities Vigilance / overall attention Selective attention: processing sth in the cost of others Distributed attention Automaticity (action / perception task that does not take capacity) Selective attention is different from general attention —- arousal.
Jun 24, 2019
Note on Computation by Biological Plausible Learning from lecture of Cengiz Penleven 2019 Philosophy Neural dynamics can be a substrate of computation. The neural dynamics and plasticity dynamics can both do optimization, and the biological constraint form a source of constraint on variables.
Jun 24, 2019