Subject
2 entries
Word Embeddings
Bookmarks
Word2Vec Explained
A clear walkthrough of Word2Vec's intuition and mechanics — skip-gram vs. CBOW, negative sampling, and why the king-queen analogy works. Good primer before reading papers on later embedding methods.
LexVec
LexVec is a Go implementation of a word embedding model that factorizes the PPMI matrix with position-dependent weighting, outperforming Word2Vec on several NLP benchmarks at the time. An interesting mid-2010s data point in the race to improve on Word2Vec before attention-based models took over.