Concentration Inequalities and Empirical Processes Theory Applied to the Analysis of Learning Algorithms
2002
Ph.D. Thesis
ei
New classification algorithms based on the notion of 'margin' (e.g. Support Vector Machines, Boosting) have recently been developed. The goal of this thesis is to better understand how they work, via a study of their theoretical performance. In order to do this, a general framework for real-valued classification is proposed. In this framework, it appears that the natural tools to use are Concentration Inequalities and Empirical Processes Theory. Thanks to an adaptation of these tools, a new measure of the size of a class of functions is introduced, which can be computed from the data. This allows, on the one hand, to better understand the role of eigenvalues of the kernel matrix in Support Vector Machines, and on the other hand, to obtain empirical model selection criteria.
Author(s): | Bousquet, O. |
Year: | 2002 |
Day: | 0 |
Department(s): | Empirische Inferenz |
Bibtex Type: | Ph.D. Thesis (phdthesis) |
School: | Biologische Kybernetik |
Degree Type: | PhD |
Digital: | 0 |
Institution: | Ecole Polytechnique |
State: | Accepted |
Links: |
PostScript
|
BibTex @phdthesis{1444, title = {Concentration Inequalities and Empirical Processes Theory Applied to the Analysis of Learning Algorithms}, author = {Bousquet, O.}, institution = {Ecole Polytechnique}, school = {Biologische Kybernetik}, year = {2002}, doi = {} } |