Query K-means clustering for crowdsourcing

This thesis focuses on solving the $K$-means clustering problem approximately with side information provided by crowdsourcing. Both binary same-cluster oracle and general crowdsourcing framework are considered. It can be shown that, under some mild assumptions on the smallest cluster size, one can obtain a (1+ε)-approximation for the optimal potential with probability at least 1-δ, where ε>0 and δ\in(0,1), using an expected number of O(\frac{K³}{ε δ}) noiseless same-cluster queries and comparison-based clustering of complexity O(ndK + \frac{K³}{ε δ}); here, $n$ denotes the number of points and $d$ the dimension of space. Compared to a handful of other known approaches that perform importance sampling to account for small cluster sizes, the proposed query technique reduces the number of queries by a factor of roughly O(\frac{K⁶}{ε³}), at the cost of possibly missing very small clusters. This setting is extended to the case where some queries to the oracle produce erroneous information, and where certain points, termed outliers, do not belong to any clusters. Incorporating state-of-the-art results in crowdsourcing can further improve the performance of the algorithm. Note that the proof techniques used in this thesis differ from previous methods used for $K$-means clustering analysis, as they rely on estimating the sizes of the clusters and the number of points needed for accurate centroid estimation and subsequent nontrivial generalizations of the double Dixie cup problem. The performances of proposed algorithms are illustrated on both synthetic and real datasets, including MNIST and CIFAR $10$.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2020

Author dc:creator

• Pan, Chao

Contributors dc:contributor

• Milenkovic, Olgica

• K-means clustering
• active learning
• semi-supervised learning
• coupon collector's problem
• crowdsourcing

Statement dc:rights

• Copyright 2019 Chao Pan

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/106229

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/106229