Show simple item record

dc.contributor.authorKim, Hyunsoo
dc.contributor.authorDrake, Barry L.
dc.contributor.authorPark, Haesun
dc.date.accessioned2007-05-23T22:01:54Z
dc.date.available2007-05-23T22:01:54Z
dc.date.issued2006
dc.identifier.urihttp://hdl.handle.net/1853/14443
dc.description.abstractThe linear discriminant analysis based on the generalized singular value decomposition (LDA/GSVD) has been introduced to circumvent the nonsingularity restriction inherent in the classical LDA. The LDA/GSVD provides a framework in which a dimension reducing transformation can be effectively obtained for undersampled problems. In this paper, relationships between support vector machines (SVMs) and the generalized linear discriminant analysis applied to the support vectors are studied. Based on the GSVD, the weight vector of the hard-margin SVM is proved to be equivalent to the dimension reducing transformation vector generated by LDA/GSVD applied to the support vectors of the binary class. We also show that the dimension reducing transformation vector and the weight vector of soft-margin SVMs are related when a subset of support vectors are considered. These results can be generalized when kernelized SVMs and the kernelized LDA/GSVD called KDA/GSVD are considered. Through these relationships, it is shown that support vector classification is related to data reduction as well as dimension reduction by LDA/GSVD.en
dc.description.sponsorshipThis material is based upon work supported in part by the National Science Foundation Grants CCR-0204109 and ACI-0305543. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.en
dc.language.isoen_USen
dc.publisherGeorgia Institute of Technologyen
dc.relation.ispartofseriesCSE Technical Reports; GT-CSE-06-16en
dc.subjectClassifier for binary classesen
dc.subjectDimension reductionen
dc.subjectGeneralized Singular Value Decomposition (GSVD)en
dc.subjectLinear discriminant analysisen
dc.subjectSupport vector machinesen
dc.titleRelationships Between Support Vector Classifiers and Generalized Linear Discriminant Analysis on Support Vectorsen
dc.typeTechnical Reporten


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record