Blind regression : understanding collaborative filtering from matrix completion to tensor completion

Neighborhood-based Collaborative filtering (CF) methods have proven to be successful in practice and are widely applied in commercial recommendation systems. Yet theoretical understanding of their performance is lacking. In this work, we introduce a new framework of Blind Regression which assumes that there are latent features associated with input variables, and we observe outputs of some Lipschitz continuous function over those unobserved features. We apply our framework to the problem of matrix completion and give a nonparametric method which, similar to CF, combines the local estimates according to the distance between the neighbors. We use the sample variance of the difference in ratings between neighbors as the proximity of the distance. Through error analysis, we show that the minimum sample variance is a good proxy of the prediction error in the estimates. Experiments on real-world datasets suggests that our matrix completion algorithm outperforms classic user-user and item-item CF approaches. Finally, our framework easily extends to the setting of higher-order tensors and we present our algorithm for tensor completion. The result from real-world application of image inpainting demonstrates that our method is competitive with the state-of-the-art tensor factorization approaches in terms of predictive performance.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2016

Author dc:creator

• Li, Yihua, M. Eng. Massachusetts Institute of Technology

Advisor dc:contributor.advisor

• Devavrat Shah.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/105983

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/105983