Soft quadratic surface support vector machine for binary classification. (English) Zbl 1354.68225
Summary: In this paper, a kernel-free soft quadratic surface support vector machine model is proposed for binary classification directly using a quadratic function for separation. Properties (including the solvability, uniqueness and support vector representation of the optimal solution) of the proposed model are derived. Results of computational experiments on some artificial and real-world classifying data sets indicate that the proposed soft quadratic surface support vector machine model may outperform Dagher’s quadratic model and other soft support vector machine models with a quadratic or Gaussian kernel in terms of the classification accuracy and robustness.
MSC:
| 68T05 | Learning and adaptive systems in artificial intelligence |
| 62-07 | Data analysis (statistics) (MSC2010) |
Keywords:
data mining; support vector machine; binary classification; quadratic optimization; kernel-free support vector machineReferences:
| [1] | Bache, K and M Lichman (2013). UCI Machine Learning Repository. URL: http://archive.ics.uci.edu/ml. Irvine, CA: University of California, School of Information and Computer Science. |
| [2] | Boser, B, I Guyon and VN Vapnik (1992). A training algorithm for optimal margin classifiers, in: Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pp. 144-152. |
| [3] | Brooks, JP (2011). Support vector machines with the ramp loss and the hard margin loss. Operations Research, 59, 467-479. genRefLink(16, ’S0217595916500469BIB003’, ’10.1287 |
| [4] | Cao, Y, GY Wan and FQ Wang (2011). Predicting financial distress of Chinese listed companies using rough set theory and support vector machine. Asia-Pacific Journal of Operational Research, 28, 95-109. [Abstract] genRefLink(128, ’S0217595916500469BIB004’, ’000287666600007’); |
| [5] | Chang, CC and CJ Lin (2013). LIBSVM: a library for support vector machines. Available at http://www.csie.ntu.edu.tw/cjlin/libsvm. |
| [6] | Chen, Z, Z Fan and M Sun (2012). A hierarchical multiple kernel support vector machine for customer churn prediction using longitudinal behavioral data. European Journal of Operational Research, 223, 461-472. genRefLink(16, ’S0217595916500469BIB006’, ’10.1016 · Zbl 1292.68131 |
| [7] | Cortes, C and VN Vapnik (1995). Support-vector networks. Machine Learning, 20, 273-297. genRefLink(16, ’S0217595916500469BIB007’, ’10.1007 |
| [8] | Cristianini, N and J Shawe-Taylor (2000). An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, 1st edn. Cambridge: Cambridge University Press. genRefLink(16, ’S0217595916500469BIB008’, ’10.1017 · Zbl 0994.68074 |
| [9] | Dagher, I (2008). Quadratic kernel-free non-linear support vector machine. Journal of Global Optimization, 41, 15-30. genRefLink(16, ’S0217595916500469BIB009’, ’10.1007 |
| [10] | Deng, N, Y Tian and C Zhang (2013). Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions. Boca Raton, FL: CRC Press. · Zbl 1278.68011 |
| [11] | Drucker, H, D Wu and VN Vapnik (1999). Support vector machines for spam categorization. IEEE Transactions on Neural Networks, 10, 1048-1054. genRefLink(16, ’S0217595916500469BIB011’, ’10.1109 |
| [12] | Fang, SC and S Puthenpura (1993). Linear Optimization and Extensions: Theory and Algorithms. Englewood Cliffs, NJ: Prentice Hall. · Zbl 0799.90080 |
| [13] | Kim, KI, K Jung, SH Park and HJ Kim (2012). Support vector machines for texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1542-1550. |
| [14] | Lin, CJ (2001). Formulations of support vector machines: a note from an optimization point of view. Neural Computation, 13, 307-317. genRefLink(16, ’S0217595916500469BIB014’, ’10.1162 |
| [15] | Liu, Y and M Yuan (2011). Reinforced multicategory support vector machines. Journal of Computational and Graphical Statistics, 20, 901-919. genRefLink(16, ’S0217595916500469BIB015’, ’10.1198 |
| [16] | Luo, J, Z Deng, D Bulatov, JE Lavery and SC Fang (2013). Comparison of an 1-regression-based and a RANSAC-based planar segmentation procedure for urban terrain data with many outliers. in Proceedings of SPIE 8892, Image and Signal Processing for Remote Sensing XIX, 2013, [doi: 10.1117/12.2028627] . |
| [17] | Martin-Barragan, B, R Lillo and J Romo (2014). Interpretable support vector machines for functional data. European Journal of Operational Research, 232, 146-155. genRefLink(16, ’S0217595916500469BIB017’, ’10.1016 |
| [18] | Schölkopf, B and AJ Smola (2002). Learning with Kernels. Cambridge, MA: MIT Press. |
| [19] | Vapnik, VN (1998). Statistical Learning Theory. New York, NY: Wiley-Interscience Publication. |
| [20] | Vapnik, VN (2000). The Nature of Statistical Learning Theory. New York, NY: Springer-Verlag. genRefLink(16, ’S0217595916500469BIB020’, ’10.1007 · Zbl 0934.62009 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
