Representation Learning

2 posts in this tag

Note on Modern Hopfield Network and Transformers

Motivation There is a resurgent of interest in investigating and developing Hopfield network in recent years. This development is quite exciting in that it connect classic models in physics and machine learning to modern techniques like transformers.

Nov 15, 2021

Note on Word2Vec

Motivation Word2Vec is a very famous method that I heard of since the freshman year in college (yeah it comes out in 2013). Recently, some reviewer reminds us of the similarity of the “analogy” learnt by the vector representation of words and the vector analogy of image space in GAN or VAE.

Nov 27, 2020

Note on Modern Hopfield Network and Transformers

Motivation There is a resurgent of interest in investigating and developing Hopfield network in recent years. This development is quite exciting in that it connect classic models in physics and machine learning to modern techniques like transformers.

tech note Unsupervised Learning Statistical Learning ML Representation Learning RNN Transformers

November 15, 2021

Note on Word2Vec

Motivation Word2Vec is a very famous method that I heard of since the freshman year in college (yeah it comes out in 2013). Recently, some reviewer reminds us of the similarity of the “analogy” learnt by the vector representation of words and the vector analogy of image space in GAN or VAE.

tech note Unsupervised Learning Statistical Learning ML Representation Learning Language NLP

November 27, 2020

tech note Unsupervised Learning Statistical Learning ML Representation Learning RNN Transformers

(2021). Note on Modern Hopfield Network and Transformers.

tech note Unsupervised Learning Statistical Learning ML Representation Learning Language NLP

(2020). Note on Word2Vec.

Related Tags

Zebrafish (1) Waves (1) Variational (1) Tutorial Series (1) Travel (1) Transformer (1) Thesis Defense (1) Thesis (1) Spectral Bias (1) Sleep (1)