Cloud architecture for search engine application

Abstract

Cloud computing has become popular because of its on demand self services capability and business benefits. This paper presents design of search engine application developed and deployed using Google app engine. The application uses pattern-matching and regular expression language processing across millions of web document and returns the matching web documents. To facilitate large dataset processing the application makes use of Apache Hadoop suite, which is distributed data processing framework that brings up hundreds of virtual servers on-demand, runs a parallel computation on them, then shuts down all the virtual servers releasing all its resources back to the cloud. The Google app engine uses cloud SQL instance to store data in the database virtually in cloud database.