Improving Search Engines Performance on Multitreading Processors
Carolina Bonacic (University Complutense of Madrid, Spain)Carlos Garcia (University Complutense of Madrid, Spain)
Mauricio Marin (Yahoo! Research Santiago, University of Chile )
Manuel Prieto (University Complutense of Madrid, Spain)
Francisco Tirado (University Complutense of Madrid, Spain)
Cesar Vicente (University Complutense of Madrid, Spain)
Abstract:
In this paper we present strategies and experiments that show how to take advantage of the multi-threading parallelism available in Chip Multithreading (CMP) processors in the context of efficient query processing for search engines. We show that scalable performance can be achieved by letting the search engine go synchronous so that batches of queries can be processed concurrently in a simple but very efficient manner. Furthermore, our results indicate that the multithreading capabilities of modern CMP systems are not fully exploited when the search engine operates on a conventional asynchronous mode due to the moderate thread level parallelism that can be extracted from a single query.
Keywords:
Parallel and Distributed Computing, High Productivity Computing
