Mining informative sentences in multi-product documents with PLSA

In this thesis, we study the problem of fetching informative sentences from multi-product documents. A multi-product document is defined as a document that mentions about multiple products, which is often for comparison purpose. An informative sentence is defined as a sentence that provides the characteristics of the product. we propose to use Probabilistic Latent Semantic Analysis (PLSA) to mine informative sentences given a single multi-product document. By applying PLSA in a multi-product document, it simultaneously solves three problems regarding to multi-product document: 1. Separate the document based on the products. 2. Fetch the informative key words for each product. 3. Fetch the informative sentences. The proposed method can mine the product information from a single multi-product document, which is quite different from previous works in opinion mining. Experiment results show that the high probability words in the word distribution of each product do discover the characteristics of the product. The results also reveal that the sentences which contain more these keywords are more informative. Practical applications of this method are: 1. Product comparison. 2. Facilitate user in reading multi-product document, which is to apply data mining in human computer interaction (HCI).

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2010

Author dc:creator

• Hwang, Hsiang-Yeh

Contributors dc:contributor

• Zhai, ChengXiang

• multi-product document
• single-product document
• informative sentences
• informative words (ie. keywords)
• product name entity

Statement dc:rights

• Copyright 2010 Hsiang-Yeh Hwang

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/16897

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/16897