Using information theoretic measures to evaluate support vector machine kernels

A new method is proposed that exploits the underlying information theoretic structure in the input data to evaluate the ability of a kernel to successfully separate a class in some feature space. This method is built on the fundamental idea that kernel density estimation in some input space is equivalent to an inner product on some Hilbert space. Estimators of Renyi's generalized form of information theoretic measurements reduce to a form that gives an elegant characterization of the geometric properties of the kernel in the feature space. It is shown how these estimators can be used to evaluate the kernel of a support vector machine.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2012

Author dc:creator

• Pierce, Austin

Contributors dc:contributor

• Blahut, Richard E.

• Renyi
• Support Vector Machine (SVM)
• Renyi Entropy

Statement dc:rights

• Copyright 2012 Austin Pierce

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/30953

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/30953