#117 · Primary category: NLP Tools & Text Processing
wikipedia2vec
A tool for learning vector representations of words and entities from Wikipedia
Project last updated:05/03/24
GitHub Stars
971
Forks
100
Contributors
5
License
Apache-2.0
Why we included this project
Wikipedia2Vec learns word and entity embeddings in the same vector space, so a name like "Apple" gets its own representation tied to the Wikipedia article rather than being treated as an ordinary token. That co-embedding makes entity linking, related-entity retrieval, and knowledge-aware classification noticeably easier to build. You can train it from a plain Wikipedia dump with a single command, no annotations or schema setup needed, and pretrained embeddings for twelve languages are available if you'd rather skip that step. The bundled NABoE example, an entity-aware text classifier built on a neural attention model, shows a practical starting point whether you're exploring the technique or wiring it into a pipeline.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量