DL meets P2P – Distributed Document Retrieval based on Classification and Content

TitleDL meets P2P – Distributed Document Retrieval based on Classification and Content
Publication TypeConference Paper
Year of Publication2005
AuthorsBalke, W. - T., W. Nejdl, W. Siberski, and U. Thaden
Conference Name9th European Conference on research and Advanced Technology for Digital Libraries (ECDL 2005)
Conference LocationVienna, Austria

Peer-to-peer architectures are a potentially powerful paradigm for retrieving documents over networks of digital libraries avoiding single points of failure by massive federation of (independent) information sources. Today sharing files over P2P infrastructures is already immensely successful, but restricted to simple metadata matching. But when it comes to the retrieval of complex documents, capabilities as provided by digital libraries are needed. Digital libraries have to cope with compound documents. Though some document parts (like embedded images) can efficiently be retrieved using metadata matching, the text-based information needs different methods like full text search. However, for effective querying of texts, also information like inverted document frequencies are essential. But due to the distributed characteristics of P2P networks such ’collection-wide’ information poses severe problems, e.g. that central updates whenever changes in any document collection occur use up valuable bandwidth.
We will present a novel indexing technique that allows to query using collection-wide information with respect to different classifications and show the effectiveness of our scheme for practical applications. We will in detail discuss our findings and present simulations for the scheme’s efficiency and scalability.

ecdl05.pdf131.87 KB