TY - GEN
T1 - Radius-margin based support vector machine with LogDet regularizaron
AU - Zhu, Yuan Yuan
AU - Wu, Xiao He
AU - Xu, Jun
AU - Zhang, David
AU - Zuo, Wang Meng
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2015/11/30
Y1 - 2015/11/30
N2 - Theoretically, Support Vector Machine (SVM) has the generalization error bound of radius-margin ratio, while the standard SVM only maximizes the margin. Several SVM variants based on the radius-margin ratio error bound have been proposed. However, most of them either require the form of the transformation matrix to be diagonal, or the optimization is computationally expensive. In this paper, we propose a novel convex radius-margin based SVM model with-LogDet regularization, ie., L-S VM Our model not only takes radius into consideration, but also increases the stability by combing the individual inequality constraints into one integrated inequality constraint. In L-SVM, we introduce a-LogDet regularization term to make the model more effective and get a dosed-form solution of the transformation matrix. Furthermore, we extend the L-SVM model to kernel space for nonlinear cases with the advantages of kernel principal component analysis. The experimental results show that L-SVM achieves significantly better performance both in accuracy and efficiency, compared to the standard SVM and the state-of-the-art radius-margin based SVM methods, e.g., RMM, R-SVM+ and R-SVM+ μ.
AB - Theoretically, Support Vector Machine (SVM) has the generalization error bound of radius-margin ratio, while the standard SVM only maximizes the margin. Several SVM variants based on the radius-margin ratio error bound have been proposed. However, most of them either require the form of the transformation matrix to be diagonal, or the optimization is computationally expensive. In this paper, we propose a novel convex radius-margin based SVM model with-LogDet regularization, ie., L-S VM Our model not only takes radius into consideration, but also increases the stability by combing the individual inequality constraints into one integrated inequality constraint. In L-SVM, we introduce a-LogDet regularization term to make the model more effective and get a dosed-form solution of the transformation matrix. Furthermore, we extend the L-SVM model to kernel space for nonlinear cases with the advantages of kernel principal component analysis. The experimental results show that L-SVM achieves significantly better performance both in accuracy and efficiency, compared to the standard SVM and the state-of-the-art radius-margin based SVM methods, e.g., RMM, R-SVM+ and R-SVM+ μ.
KW - Feature transformation
KW - LogDet regularization
KW - Radius-margin ratio
KW - Support vector machine
UR - https://www.scopus.com/pages/publications/85020724418
U2 - 10.1109/ICMLC.2015.7340935
DO - 10.1109/ICMLC.2015.7340935
M3 - 会议稿件
AN - SCOPUS:85020724418
T3 - Proceedings - International Conference on Machine Learning and Cybernetics
SP - 277
EP - 282
BT - Proceedings of 2015 International Conference on Machine Learning and Cybernetics, ICMLC 2015
PB - IEEE Computer Society
T2 - 14th International Conference on Machine Learning and Cybernetics, ICMLC 2015
Y2 - 12 July 2015 through 15 July 2015
ER -