A hybrid method for rating prediction using linked data features and text reviews

Yumusak, Semih
Muñoz, Emir
Minervini, Pasquale
Dogdu, Erdogan
Kodaz, Halife
Yumusak, Semih, Muñoz, Emir, Minervini, Pasquale, Dogdu, Erdogan, & Kodaz, Halife. (2016). A hybrid method for rating prediction using linked data features and text reviews. Paper presented at the Know@LOD 2015, 4th Workshop on Knowledge Discovery and Data Mining Meets Linked Open Data co-located with 12th Extended Semantic Web Conference (ESWC 2015), Portoroz, Slovenia.
This paper describes our entry for the Linked Data Mining Challenge 2016, which poses the problem of classifying music albums as good or bad by mining Linked Data. The original labels are assigned according to aggregated critic scores published by the Metacritic s website. To this end, the challenge provides datasets that contain the DBpedia reference for music albums. Our approach benefits from Linked Data (LD) and free text to extract meaningful features that help to separate these two classes of music albums. Thus, our features can be summarized as follows: (1) direct object LD features, (2) aggregated count LD features, and (3) textual review features. We filtered out those properties somehow related with scores and Metacritic to build unbiased models. By using these sets of features, we trained seven models using 10-fold cross validation to estimate performance. We reached the best average accuracy of 87.81% in the training data using a Linear SVM model and all our features, while we reached 90% in the testing data.
Publisher DOI
Attribution-NonCommercial-NoDerivs 3.0 Ireland