Parallel implementations of probabilistic latent semantic analysis on graphic processing units

Probabilistic Latent Semantic Analysis (PLSA) has been successfully applied to many text mining tasks such as retrieval, clustering, summarization, etc. PLSA involves iterative computation for a large number of parameters and may take hours or even days to process a large dataset, thus speeding up PLSA is highly motivated in the domain of text mining. Recently, the general purpose graphic processing units (GPGPU) have become a powerful parallel computing platform, not only because of GPU's multi-core structure and high memory bandwidth, but also because of the recent efforts devoted into building a programming framework to enable developers to easily manipulate GPU's computing power. In this paper, we introduced two methods to parallelize and speed up PLSA via GPGPU. Related issues are addressed including workload balance, block-thread layout, memory and data access optimization, etc. The GPU in use is NVidia GTX480 (costs $450 in market). Experimental results show that our methods can process 300,000 documents in 12 seconds which is a 33x speedup compared with traditional PLSA implementation running on 3.0GHz Intel Xeon CPU. The significant speedup can bring researchers in the text mining domain brand new experience.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2011

Author dc:creator

• Chen, Hang

Contributors dc:contributor

• Zhai, ChengXiang

• Probabilistic latent semantic analysis (PLSA)
• Graphics processing unit (GPU)
• Compute Unified Device Architecture (CUDA)
• speedup
• parallel
• workload balance
• memory schema
• optimization

Statement dc:rights

• Copyright 2010 Hang Chen

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/18415

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/18415