Benchmarking Domain-Specific Expert Search Using Workshop Program Committees
Bordea, Georgeta Buitelaar, Paul
Bordea, Georgeta
Buitelaar, Paul
Loading...
Identifiers
http://dl.acm.org/citation.cfm?id=2508501
http://hdl.handle.net/10379/4131
https://doi.org/10.13025/21115
http://hdl.handle.net/10379/4131
https://doi.org/10.13025/21115
Repository DOI
Publication Date
2013
Keywords
Type
Conference Paper
Downloads
Citation
Bordea, G., Bogers, T., & Buitelaar, P. Benchmarking domain-specific expert search using workshop program committees. Paper presented at the Proceedings of the 2013 workshop on Computational scientometrics: theory & applications.
Abstract
Traditionally, relevance assessments for expert search have been gathered through self-assessment or based on the opinions of co-workers. We introduce three benchmark datasets1 for expert search that use conference workshops for relevance assessment. Our data sets cover entire research domains as opposed to single institutions. In addition, they provide a larger number of topic-person associations and allow a more objective and fine-grained evaluation of expertise than existing data sets do. We present and discuss baseline results for a language modelling and a topic-centric approach to expert search. We find that the topic-centric approach achieves the best results on domain-specific datasets.
Funder
Publisher
ACM
Publisher DOI
Rights
Attribution-NonCommercial-NoDerivs 3.0 Ireland