#117 · Primary category: NLP Tools & Text Processing

wikipedia2vec

embeddings natural-language-processing nlp python text-classification wikipedia

A tool for learning vector representations of words and entities from Wikipedia

Project last updated:05/03/24

GitHub Stars

971

Forks

100

Contributors

5

License

Apache-2.0

Why we included this project

Wikipedia2Vec learns word and entity embeddings in the same vector space, so a name like "Apple" gets its own representation tied to the Wikipedia article rather than being treated as an ordinary token. That co-embedding makes entity linking, related-entity retrieval, and knowledge-aware classification noticeably easier to build. You can train it from a plain Wikipedia dump with a single command, no annotations or schema setup needed, and pretrained embeddings for twelve languages are available if you'd rather skip that step. The bundled NABoE example, an entity-aware text classifier built on a neural attention model, shows a practical starting point whether you're exploring the technique or wiring it into a pipeline.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category