Wikipedia2Vec: An Efficient Toolkit for Learning and Visualizing the Embeddings of Words and Entities from Wikipedia (original) (raw)
Abstract:The embeddings of entities in a large knowledge base (e.g., Wikipedia) are highly beneficial for solving various natural language tasks that involve real world knowledge. In this paper, we present Wikipedia2Vec, a Python-based open-source tool for learning the embeddings of words and entities from Wikipedia. The proposed tool enables users to learn the embeddings efficiently by issuing a single command with a Wikipedia dump file as an argument. We also introduce a web-based demonstration of our tool that allows users to visualize and explore the learned embeddings. In our experiments, our tool achieved a state-of-the-art result on the KORE entity relatedness dataset, and competitive results on various standard benchmark datasets. Furthermore, our tool has been used as a key component in various recent studies. We publicize the source code, demonstration, and the pretrained embeddings for 12 languages at this https URL.
Submission history
From: Ikuya Yamada [view email]
[v1] Sat, 15 Dec 2018 12:51:39 UTC (383 KB)
[v2] Wed, 26 Dec 2018 14:25:27 UTC (383 KB)
[v3] Thu, 30 Jan 2020 10:58:05 UTC (678 KB)
[v4] Sat, 26 Sep 2020 14:28:42 UTC (7,752 KB)