A decentralized, adaptive replica location mechanism

TitleA decentralized, adaptive replica location mechanism
Publication TypeConference Paper
Year of Publication2002
AuthorsRipeanu, M., and I. Foster
Conference NameHigh Performance Distributed Computing, 2002. HPDC-11 2002. Proceedings. 11th IEEE International Symposium on
Pagination24 - 32
Keywordsadaptive communication schedules, decentralization, distributed systems, flat overlay network, probabilistic representations, query latency, replica location, replicated databases, resource consumption evaluation, soft-state protocols, wide area networks, wide-area distributed systems
Abstract

We describe a decentralized, adaptive mechanism for replica location in wide-area distributed systems. Unlike traditional, hierarchical (e.g, DNS) and more recent (e.g., CAN, Chord, Gnutella) distributed search and indexing schemes, nodes in our location mechanism do not route queries, instead, they organize into an overlay network and distribute location information. We contend that this approach works well in environments where replica location queries are prevalent but the dynamic component of the system (e.g., node and network failures, replica add/delete operations) cannot be neglected. We argue that a replica location mechanism that combines probabilistic representations of replica location information with soft-state protocols and a flat overlay network of nodes brings important benefits: genuine decentralization, low query latency, and flexibility to introduce adaptive communication schedules. We support these claims in two ways. First, we provide a rough resource consumption evaluation: we show that, for environments similar to those encountered in large scientific data analysis projects, generated network traffic is limited and, more importantly, is comparable to the traffic generated by a request routing scheme. Second, we provide encouraging performance data from a prototype implementation.

URLhttp://dx.doi.org/10.1109/HPDC.2002.1029900
DOI10.1109/HPDC.2002.1029900

a place of mind, The University of British Columbia

Electrical and Computer Engineering
2332 Main Mall
Vancouver, BC Canada V6T 1Z4
Tel +1.604.822.2872
Fax +1.604.822.5949
Email:

Emergency Procedures | Accessibility | Contact UBC | © Copyright 2020 The University of British Columbia