Simultaneous use of CPU and GPU to real time inverted index updating in Microblogs

Abstract

Nowadays, with attention to developing the different data networks, the wide masses of data are producing and updating continually. Managing the great data enumerate the fundamental challenges in data mining. One of the considered main subjects in this context is how searching among the wide masses of data. Therefore, require to producing the typical powerful, expansible and efficient file of documents and data for using in search motors is necessary. In this study, with surveying the done prior works, implementing the inverted index with the immediate updating capability from the dynamic and little data of microblogs is targeted. With utilization from processing multicore facility, the approach of the graphical processing unit (GPU) is presented that as expansible and without decreasing the attention, the index file is prepared with suitable speed, as the mentioned file is usable in inquiry unit. This method tries to feed the updating unit continually with separating the operation for the system Central Processing Unit (CPU) and suitable utilization of parallel processing capability of CUDA core. Also, in parallel to increasing the quality, one Hint method is presented for employing the vacant cores and compactor function for decreasing the index file mass. The results indicate that the presence of necessary hardware, the presented method in identity to immediate updating slogan, have the upper speed for making the inverted index of microblogs than to available samples.