CLSep 2, 2013
Tagging Scientific Publications using Wikipedia and Natural Language Processing Tools. Comparison on the ArXiv DatasetMichał Łopuszyński, Łukasz Bolikowski
In this work, we compare two simple methods of tagging scientific publications with labels reflecting their content. As a first source of labels Wikipedia is employed, second label set is constructed from the noun phrases occurring in the analyzed corpus. We examine the statistical properties and the effectiveness of both approaches on the dataset consisting of abstracts from 0.7 million of scientific documents deposited in the ArXiv preprint collection. We believe that obtained tags can be later on applied as useful document features in various machine learning tasks (document similarity, clustering, topic modelling, etc.).
IRMar 26, 2013
Large scale citation matching using Apache HadoopMateusz Fedoryszak, Dominika Tkaczyk, Łukasz Bolikowski
During the process of citation matching links from bibliography entries to referenced publications are created. Such links are indicators of topical similarity between linked texts, are used in assessing the impact of the referenced document and improve navigation in the user interfaces of digital libraries. In this paper we present a citation matching method and show how to scale it up to handle great amounts of data using appropriate indexing and a MapReduce paradigm in the Hadoop environment.