Publication

Picshark: mitigating metadata scarcity through large-scale p2p collaboration

Cudré-Mauroux, Philippe
; 
Budura, Adriana
; 
Hauswirth, Manfred
; 
Aberer, Karl
Repository DOI
Publication Date
2008-07-15
Keywords
metadata scarcity, metadata heterogeneity, metadata entropy, peer-to-peer collaboration, peer data management, management, project
Type
Article
Downloads
Show all metadata
Citation
Cudré-Mauroux, Philippe; Budura, Adriana; Hauswirth, Manfred; Aberer, Karl (2008). Picshark: mitigating metadata scarcity through large-scale p2p collaboration. The VLDB Journal 17 (6), 1371-1384
Abstract
With the commoditization of digital devices, personal information and media sharing is becoming a key application on the pervasive Web. In such a context, data annotation rather than data production is the main bottleneck. Metadata scarcity represents a major obstacle preventing efficient information processing in large and heterogeneous communities. However, social communities also open the door to new possibilities for addressing local metadata scarcity by taking advantage of global collections of resources. We propose to tackle the lack of metadata in large-scale distributed systems through a collaborative process leveraging on both content and metadata. We develop a community-based and self-organizing system called PicShark in which information entropy-in terms of missing metadata-is gradually alleviated through decentralized instance and schema matching. Our approach focuses on semi-structured metadata and confines computationally expensive operations to the edge of the network, while keeping distributed operations as simple as possible to ensure scalability. PicShark builds on structured Peer-to-Peer networks for distributed look-up operations, but extends the application of self-organization principles to the propagation of metadata and the creation of schema mappings. We demonstrate the practical applicability of our method in an image sharing scenario and provide experimental evidences illustrating the validity of our approach.
Funder
Publisher
Springer Nature
Publisher DOI
10.1007/s00778-008-0103-4
Rights
Attribution-NonCommercial-NoDerivs 3.0 Ireland
cbn
Collections
Externally hosted open access publications with University of Galway authors (2)