Distributed Paged Hash Tables |
---|
José Rufino - Polytechnic Institute of Bragança António Pina - University of Minho Albano Alves - Polytechnic Institute of Bragança José Exposto - Polytechnic Institute of Bragança |
In this paper we present the design and implementation of DPH, a storage layer for cluster environments. DPH is a Distributed Data Structure (DDS) based on the distribution of a paged hash table. It combines main memory with file system resources across the cluster in order to implement a distributed dictionary that can be used for the storage of very large data sets with key based addressing techniques. The DPH storage layer is supported by a collection of cluster--aware utilities and services. Access to the DPH interface is provided by a user--level API. A preliminary performance evaluation shows promising results. |