Multiclass functional discriminant analysis and its application to gesture recognition. (English) Zbl 1226.62061
Summary: We consider applying a functional logistic discriminant procedure to the analysis of handwritten character data. Time-course trajectories corresponding to the X and Y coordinate values of handwritten characters written in the air with one finger are converted into a functional data set via regularized basis expansion. We then apply functional logistic modeling to classify the functions into several classes. In order to select the values of adjusted parameters involved in the functional logistic model, we derive a model selection criterion for evaluating models estimated by the method of regularization. Results indicate the effectiveness of our modeling strategy in terms of prediction accuracy.
MSC:
| 62H30 | Classification and discrimination; cluster analysis (statistical aspects) |
| 68T10 | Pattern recognition, speech recognition |
| 62J12 | Generalized linear models (logistic models) |
| 65C60 | Computational problems in statistics (MSC2010) |
References:
| [1] | ANDO, T., KONISHI, S., and IMOTO, S. (2008),”Nonlinear Regression Modeling Via Regularized Radial Basis Function Networks,” Journal of Statistical Planning and Inference, 138, 3617–3633. · Zbl 1152.62039 · doi:10.1016/j.jspi.2005.07.014 |
| [2] | ARAKI, Y., KONISHI, S., and IMOTO, S. (2004), ”Functional Discriminant Analysis for Microarray Gene Expression Data Via Radial Basis Function Networks,” in Proceedings of COMPSTAT 2004, Heidelberg: Physica-Verlag/Springer, pp. 613–620. |
| [3] | ARAKI, Y., KONISHI, S., KAWANO, S., and MATSUI, H. (2009), ”Functional Regression Modeling Via Regularized Gaussian Basis Expansions”, Annals of the Institute of Statistical Mathematics, 61, 811–833. · Zbl 1332.62237 · doi:10.1007/s10463-007-0161-1 |
| [4] | BAHLMANN, C., and BURKHARDT, H. (2004), ”The Writer Independent Online Handwriting Recognition System Frog on Hand and Cluster Generative Statistical Dynamic TimeWarping”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 299–310. · doi:10.1109/TPAMI.2004.1262308 |
| [5] | BIAU, G., BUNEA, F., and WEGKAMP, M. (2005), ”Functional Classification in Hilbert Spaces,” IEEE Transactions on Information Theory, 51, 2163–2172. · Zbl 1285.94015 · doi:10.1109/TIT.2005.847705 |
| [6] | BISHOP, C.M. (2006), Pattern Recognition and Machine Learning, New York: Springer- Verlag. · Zbl 1107.68072 |
| [7] | BUNKE, H., ROTH, M., and SCHUKAT-TALAMAZZINI, E.G. (1995), ”Off-line Cursive Handwriting Recognition Using Hidden Markov Models,” Pattern Recognition, 28, 1399–1413. · doi:10.1016/0031-3203(95)00013-P |
| [8] | FERRATY, F., and VIEU, P. (2006), Nonparametric Functional Data Analysis, London: Springer-Verlag. · Zbl 1119.62046 |
| [9] | FERR’E, L., and VILLA, N. (2006), ”Multi-layer Perceptron with Functional Inputs: An Inverse Regression Approach,” Scandinavian Journal of Statistics, 33, 807–823. · Zbl 1164.62339 · doi:10.1111/j.1467-9469.2006.00496.x |
| [10] | FUJII, T., and KONISHI, S. (2006), ”Nonlinear Regression Modeling Via Regularized Wavelets and Smoothing Parameter Selection,” Journal of Multivariate Analysis, 97, 2023–2033. · Zbl 1101.62028 · doi:10.1016/j.jmva.2005.12.009 |
| [11] | HASTIE, T., BUJA, A., and TIBSHIRANI, R. (1995), ”Penalized Discriminant Analysis,” Annals of Statistics, 23, 73–102. · Zbl 0821.62031 · doi:10.1214/aos/1176324456 |
| [12] | HASTIE, T., TIBSHIRANI, R., and FRIEDMAN, J. (2001), The Elements of Statistical Learning, New York: Springer–Verlag. · Zbl 0973.62007 |
| [13] | JAMES, G., and HASTIE, T. (2001), ”Functional Linear Discriminant Analysis for Irregularly Sampled Curves,” Journal of Royal Statistical Society B, 63, 533–550. · Zbl 0989.62036 · doi:10.1111/1467-9868.00297 |
| [14] | JAMES, G. (2002), ”Generalized Linear Models with Functional Predictor Variables,” Journal of Royal Statistical Society B, 64, 411–432. · Zbl 1090.62070 · doi:10.1111/1467-9868.00342 |
| [15] | JAMES, G.M., and SILVERMAN, B.W. (2005), ”Functional Adaptive Model Estimation,” Journal of the American Statistical Association, 100, 565–576. · Zbl 1117.62364 · doi:10.1198/016214504000001556 |
| [16] | KADOUS,M.W. (1999), ”Learning Comprehensible Descriptions of Multivariate Time Series”, in Proceedings of the International Conference of Machine Learning, pp. 454–463. |
| [17] | KONISHI, S., ANDO, T., and IMOTO, S. (2004), ”Bayesian Information Criteria and Smoothing Parameter Selection in Radial Basis Function Networks,” Biometrika, 91, 27–43. · Zbl 1132.62313 · doi:10.1093/biomet/91.1.27 |
| [18] | KONISHI, S., and KITAGAWA, G. (2008), Information Criteria and Statistical Modeling, New York: Springer-Verlag. · Zbl 1172.62003 |
| [19] | LIU, C.L., NAKASHIMA, H., SAKO, H., and FUJISAWA, H. (2003), ”Handwritten Digit Recognition: Benchmarking of State-of-the-Art Techniques,” Pattern Recognition, 36, 2271–2285. · Zbl 1054.68124 · doi:10.1016/S0031-3203(03)00085-2 |
| [20] | MOODY, J., and DARKEN, C.J. (1989), ”Fast Learning in Networks of Locally–tuned Processing Units,” Neural Computation, 1, 281–294. · doi:10.1162/neco.1989.1.2.281 |
| [21] | RAMSAY, J.O., and SILVERMAN, B.W. (2002), Applied Functional Data Analysis, New York: Springer-Verlag. · Zbl 1011.62002 |
| [22] | RAMSAY, J.O., and SILVERMAN, B.W. (2005), Functional Data Analysis (2nd ed.), New York: Springer-Verlag. · Zbl 1079.62006 |
| [23] | ROSSI, F., and CONAN-GUEZ, B. (2005), ”Functional Multi-layer Perceptron: A Nonlinear Tool for Functional Data Analysis,” Neural Networks, 18, 45–60. · Zbl 1085.68134 · doi:10.1016/j.neunet.2004.07.001 |
| [24] | ROSSI, F., and VILLA, N. (2006), ”Support Vector Machine for Functional Data Classification,” Neurocomputing, 69, 730–742. · doi:10.1016/j.neucom.2005.12.010 |
| [25] | SCHWARZ, G. (1978), ”Estimating the Dimension of a Model,” Annals of Statistics, 6, 461–464. · Zbl 0379.62005 · doi:10.1214/aos/1176344136 |
| [26] | STARNER, T.,WEAVER, J., and PENTLAND, A. (1998), ”Real-time American Sign Language Recognition Using Desk and Wearable Computer-based Video,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 1371–1375. · doi:10.1109/34.735811 |
| [27] | VAN LAARHOVEN, P.J., and AARTS, E.H. (1987), Simulated Annealing: Theory and Applications, Dordrecht: D. Reidel Publishing. · Zbl 0643.65028 |
| [28] | YOON, H.S., SOH, J., MIN, B., and YANG, H.S. (1999), ”Recognition of Alphabetical Hand Gestures Using Hidden Markov Model,” IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 82, 1358–1366. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
