Identifying customer needs from user-generated content

Understanding customer needs is an important part of marketing strategy, product development, and marketing research. The explosive growth of user-generated content (UGC) creates an opportunity to enhance industry-standard interview-based approaches for identifying customer needs. However, the traditional manual review approach is neither efficient nor effective when applied to a large UGC corpus because non-informative and repetitive content crowd out information about customer needs. We identify customer needs from UGC by combining machine learning methods to select content for review with human judgement to formulate customer needs. In particular, we use a convolutional neural network to filter out non-informative content and dense sentence representations to identify sufficiently different sentences for manual review. An empirical proof-of-concept compares customer needs for oral care products identified from online reviews (UGC) with customer needs identified by a third-party professional consulting firm using industry-standard methods. In this application, UGC identifies additional customer needs, unreachable by the interview-based approach. Our approach improves efficiency of manual review in terms of a number of unique customer needs per unit effort.

Department dc:contributor.department

Sloan School of Management.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2017

Author dc:creator

• Timoshenko, Artem

Advisor dc:contributor.advisor

• John R. Hauser.

• Sloan School of Management.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/109648

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/109648