×

A method to make multiple hypotheses with high cumulative recognition rate using SVMs. (English) Zbl 1059.68092

Summary: This paper describes a method to make multiple hypotheses with high cumulative recognition rate using SVMs. To make just a single hypothesis by using SVMs, it has been shown that Directed Acyclic Graph Support Vector Machines (DAGSVM) is very good with respect to recognition rate, learning time and evaluation time. However, DAGSVM is not directly applicable to make multiple hypotheses. In this paper, we propose a hybrid method of DAGSVM and Max-Win algorithm. Based on the result of DAGSVM, a limited set of classes are extracted. Then, Max-Win algorithm is applied to the set. We also provide the experimental results to show that the cumulative recognition rate of our method is as good as the Max-Win algorithm, and that the execution time is almost as fast as DAGSVM.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
68T10 Pattern recognition, speech recognition
68W05 Nonnumerical algorithms

Software:

SVMlight
Full Text: DOI

References:

[1] Cortes, C.; Vapnik, V., Support vector networks, Mach. Learn., 20, 3, 273-297 (1995) · Zbl 0831.68098
[2] Vapnik, V., Statistical Learning Theory (1998), Wiley: Wiley New York · Zbl 0935.62007
[3] Hsu, C.-W.; Lin, C.-J., A comparison of methods for multi-class support vector machines, IEEE Trans. Neural Networks, 13, 415-425 (2002)
[4] Duda, R.; Stock, D.; Hart, P., Pattern Classification and Scene Analysis (2000), Wiley: Wiley New York
[5] Platt, J. C.; Cristianini, N.; Shawe-Taylor, J., Large margin DAGs for multiclass classification, Adv. Neural Inform. Process. Syst., 12, 547-553 (2000)
[6] K. Maruyama, Y. Nakano, Recognition method for cursive Japanese word written in Latin characters, Proceedings of the Seventh IWFHR, 2000, pp. 133-142.; K. Maruyama, Y. Nakano, Recognition method for cursive Japanese word written in Latin characters, Proceedings of the Seventh IWFHR, 2000, pp. 133-142.
[7] C.-L. Liu, K. Nakashima, H. Sako, H. Fujisawa, Handwritten digit recognition using state-of-the-art techniques, Proceedings of the Eighth IWFHR, 2002, pp. 320-325.; C.-L. Liu, K. Nakashima, H. Sako, H. Fujisawa, Handwritten digit recognition using state-of-the-art techniques, Proceedings of the Eighth IWFHR, 2002, pp. 320-325. · Zbl 1054.68124
[8] F. Wang, L. Vuurpijl, L. Schomaker, Support vector machines for the classification of western handwritten capitals, Proceedings of the Seventh IWFHR, 2000, pp. 167-176.; F. Wang, L. Vuurpijl, L. Schomaker, Support vector machines for the classification of western handwritten capitals, Proceedings of the Seventh IWFHR, 2000, pp. 167-176.
[9] E. Osuna, R. Freund, F. Girosi, Training support vector machines: an application to face detection, Proceedings of the CVPR’97, 1997, pp. 130-136.; E. Osuna, R. Freund, F. Girosi, Training support vector machines: an application to face detection, Proceedings of the CVPR’97, 1997, pp. 130-136.
[10] Heisele, B.; Serre, T.; Pontil, M.; Vetter, T.; Poggio, T., Categorization by learning and combining object parts, Adv. Neural Inform. Process. Syst., 14, 2, 1239-1245 (2002)
[11] M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, T. Poggio, Pedestrian detection using wavelet templates, Proceedings of the CVPR’97, 1997, pp. 193-199.; M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, T. Poggio, Pedestrian detection using wavelet templates, Proceedings of the CVPR’97, 1997, pp. 193-199.
[12] T. Joachims, Text categorization with support vector machines: learning with many relevant features, Proceedings of the European Conference on Machine Learning, 1998, pp. 137-142.; T. Joachims, Text categorization with support vector machines: learning with many relevant features, Proceedings of the European Conference on Machine Learning, 1998, pp. 137-142.
[13] Chapelle, O.; Vapnik, V.; Bousquet, O.; Mukherjee, S., Choosing multiple parameters for support vector machines, Mach. Learn., 41, 1, 131-159 (2002) · Zbl 0998.68101
[14] Platt, J. C., Fast training of support vector machines using sequential minimal optimization, (Schölkopf, B.; Burges, C. J.C.; Smola, A. J., Advanced in Kernel Methods-Support Vector Learning (1999), MIT Press: MIT Press Cambridge)
[15] Mori, S.; Suen, C. Y.; Yamamoto, K., Historical review of OCR research and development, Proceedings of the IEEE, 80, 7, 1029-1058 (1992)
[16] Joachims, T., Making large-scale SVM learning practical, (Schölkopf, B.; Burges, C. J.C.; Smola, A. J., Advanced in Kernel Methods-Support Vector Learning (1999), MIT Press: MIT Press Cambridge), 169-184
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.