Fuzzy quadratic surface support vector machine based on Fisher discriminant analysis. (English) Zbl 1317.62056
Summary: In this paper, using the concept of Fisher discriminant analysis and a new fuzzy membership function, a kernel-free fuzzy quadratic surface support vector machine model is proposed for binary classification. The membership function is specially designed to consider not only the “quadratic-margin distance” between a training point and its related “quadratic center surface” but also the affinity among training points. A decomposition algorithm is designed to solve the proposed model. Computational results on artificial and four real-world classifying data sets indicate that the proposed model outperforms fuzzy support vector machine models with Gaussian or Quadratic kernel and soft quadratic surface support vector machine model, especially, when the data sets contain a large amount of outliers and noises.
MSC:
| 62H30 | Classification and discrimination; cluster analysis (statistical aspects) |
| 90C20 | Quadratic programming |
Keywords:
support vector machine; Fisher discriminant analysis; kernel-free SVM; fuzzy membership function; quadratic surfaceSoftware:
UCI-mlReferences:
| [1] | L. T. H. An, A continuous approach for the concave cost supply problem via DC programming and DCA,, Discrete Applied Mathematics, 156, 325 (2008) · Zbl 1190.90142 · doi:10.1016/j.dam.2007.03.024 |
| [2] | W. An, Fuzzy support vector machine based on within-class scatter for classification problems with outliers or noises,, Neurocomputing, 110, 101 (2013) · doi:10.1016/j.neucom.2012.11.023 |
| [3] | K. Bache, <em>UCI Machine Learning Repository, Irvine, CA: University of California, School of Information and Computer Science</em>,, 2013. Available from: <a href= |
| [4] | M. Bicego, Soft clustering using weighted one-class support vector machines,, Pattern Recognition, 42, 27 (2009) · Zbl 1173.68623 · doi:10.1016/j.patcog.2008.07.004 |
| [5] | J. P. Brooks, Support vector machines with the ramp loss and the hard margin loss,, Operations Research, 59, 467 (2011) · Zbl 1228.90057 · doi:10.1287/opre.1100.0854 |
| [6] | H.-G. Chew, On regularisation parameter transformation of support vector machines,, Journal of Industrial and Management Optimization, 5, 403 (2009) · Zbl 1185.68519 · doi:10.3934/jimo.2009.5.403 |
| [7] | I. Dagher, Quadratic kernel-free non-linear support vector machine,, Journal of Global Optimization, 41, 15 (2008) · Zbl 1216.62003 · doi:10.1007/s10898-007-9162-0 |
| [8] | R. A. Fisher, The use of multiple measurements in taxonomic problems,, Annals of Human Genetics, 7, 179 (1936) · doi:10.1111/j.1469-1809.1936.tb02137.x |
| [9] | X. Jiang, Fuzzy SVM with a new fuzzy membership function,, Neural Computing and Applications, 15, 268 (2006) · doi:10.1007/s00521-006-0028-z |
| [10] | T. Joachims, Text categorization with support vector machines: learning with many relevant features,, Machine Learning: ECML-98, 1398, 137 (1998) · doi:10.1007/BFb0026683 |
| [11] | S. B. Kazmi, Wavelets-based facial expression recognition using a bank of support vector machines,, Soft Computing, 16, 369 (2012) · doi:10.1007/s00500-011-0721-4 |
| [12] | C. F. Lin, Fuzzy support vector machines,, IEEE Transactions on Neural Networks, 13, 464 (2002) |
| [13] | Y. Liu, Reinforced multicategory support vector machines,, Journal of Computational and Graphical Statistics, 20, 901 (2011) · doi:10.1198/jcgs.2010.09206 |
| [14] | J. Luo, Comparison of an \(l_1\)-regression-based and a RANSAC-based planar segmentation procedure for urban terrain data with many outliers,, Image and Signal Processing for Remote Sensing XIX, 8892 (2013) · doi:10.1117/12.2028627 |
| [15] | J. Luo, <em>Quadratic Surface Support Vector Machine for Binary Classification,</em>, Submitted to Neurocomputing (2014) |
| [16] | K. Schittkowski, Optimal parameter selection in support vector machines,, Journal of Industrial and Management Optimization, 1, 465 (2005) · Zbl 1101.90073 · doi:10.3934/jimo.2005.1.465 |
| [17] | F. E. H. Tay, Application of support vector machines in financial time series forecasting,, Omega, 29, 309 (2001) · doi:10.1016/S0305-0483(01)00026-3 |
| [18] | V. N. Vapnik, <em>The Nature of Statistical Learning Theory</em>,, \(2^{nd}\) edition (2000) · Zbl 0934.62009 · doi:10.1007/978-1-4757-3264-1 |
| [19] | C. Wu, A DC programming approach for sensor network localization with uncertainties in archor positions,, Journal of Industrial and Management Optimization, 10, 817 (2014) · Zbl 1292.90314 · doi:10.3934/jimo.2014.10.817 |
| [20] | Y. Wu, Robust truncated hinge loss support vector machines,, Journal of the American Statistical Association, 102, 974 (2007) · Zbl 1469.62293 · doi:10.1198/016214507000000617 |
| [21] | X. Zhang, Fuzzy support vector machine based on affinity among samples,, Journal of Software, 17, 951 (2006) · Zbl 1095.68660 · doi:10.1360/jos170951 |
| [22] | G. Zhang, LS-SVM approximate solution for affine nonlinear systems with partially unknown systems,, Journal of Industrial and Management Optimization, 10, 621 (2014) · Zbl 1274.65023 · doi:10.3934/jimo.2014.10.621 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
