Wiki2Vec. Getting Word2vec vectors for entities and word from Wikipedia Dumps
Generate Word2Vec vectors for DBpedia entities from Wikipedia dumps, linking words and topics to structured knowledge.
What is Wiki2Vec. Getting Word2vec vectors for entities and word from Wikipedia Dumps?
Wiki2Vec is a toolset for generating Word2Vec vectors from Wikipedia dumps, specifically designed to produce embeddings for DBpedia entities. It transforms Wikipedia articles into a tokenized corpus where links are replaced with DBpedia IDs, allowing the training of models that capture semantic relationships between words and knowledge base entities. This enables applications like entity linking, semantic search, and knowledge graph-enhanced NLP.
NLP researchers, data scientists, and developers working on projects that require entity-aware word embeddings, such as knowledge graph integration, semantic similarity, or entity disambiguation tasks.
It provides an open-source, reproducible pipeline to create custom entity embeddings from any Wikipedia dump, offering flexibility in language, stemming, and model parameters unlike static pre-trained models. The integration with Spark ensures scalability for large datasets.
Overview
Generating Vectors for DBpedia Entities via Word2Vec and Wikipedia Dumps. Questions? https://gitter.im/idio-opensource/Lobby
Use Cases
Best For
- Generating custom Word2Vec models with entity annotations for research experiments
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
