Bounded generalized Gaussian mixture model. (English) Zbl 1342.68270
Summary: The generalized Gaussian mixture model (GGMM) provides a flexible and suitable tool for many computer vision and pattern recognition problems. However, generalized Gaussian distribution is unbounded. In many applications, the observed data are digitalized and have bounded support. A new bounded generalized Gaussian mixture model (BGGMM), which includes the Gaussian mixture model (GMM), Laplace mixture model (LMM), and GGMM as special cases, is presented in this paper. We propose an extension of the generalized Gaussian distribution in this paper. This new distribution has a flexibility to fit different shapes of observed data such as non-Gaussian and bounded support data. In order to estimate the model parameters, we propose an alternate approach to minimize the higher bound on the data negative log-likelihood function. We quantify the performance of the BGGMM with simulations and real data.
MSC:
| 68T05 | Learning and adaptive systems in artificial intelligence |
| 68T10 | Pattern recognition, speech recognition |
| 68T45 | Machine vision and scene understanding |
Software:
PRMLTReferences:
| [1] | McLachlan, G.; Peel, D., Finite Mixture Models (2000), Wiley: Wiley New York · Zbl 0963.62061 |
| [2] | Bishop, C. M., Pattern Recognition and Machine Learning (2006), Springer: Springer Berlin, Germany · Zbl 1107.68072 |
| [3] | Jain, A. K.; Duin, R. P.W.; Mao, J., Statistical pattern recognitiona review, IEEE Trans. Pattern Anal. Mach. Intell., 22, 1, 4-37 (2000) |
| [4] | Dempster, P.; Laird, N. M.; Rubin, D. B., Maximum likelihood from incomplete data via EM algorithm, J. R. Stat. Soc., 39, 1, 1-38 (1977) · Zbl 0364.62022 |
| [5] | Yang, M. S.; Lai, C. Y.; Lin, C. Y., A robust EM clustering algorithm for Gaussian mixture models, Pattern Recognit., 45, 11, 3950-3961 (2012) · Zbl 1242.68260 |
| [6] | Peel, D.; McLachlan, G., Robust mixture modeling using the t distribution, Stat. Comput., 10, 339-348 (2000) |
| [7] | Liu, C.; Rubin, D., ML estimation of the t distribution using EM and its extensions ECM and ECME, Stat. Sin., 5, 1, 19-39 (1995) · Zbl 0824.62047 |
| [8] | Xin, W.; Zhen, Y., The infinite Students t-factor mixture analyzer for robust clustering and classification, Pattern Recognit., 45, 12, 4346-4357 (2012) · Zbl 1248.68420 |
| [9] | Do, M. N.; Vetterli, M., Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance, IEEE Trans. Image Process., 11, 2, 146-158 (2002) |
| [10] | Choy, S. K.; Tong, C. S., Statistical wavelet subband characterization based on generalized gamma density and its application in texture retrieval, IEEE Trans. Image Process., 19, 2, 281-289 (2010) · Zbl 1371.94095 |
| [11] | Allili, M., Wavelet modeling using finite mixtures of generalized Gaussian distributionsapplication to texture discrimination and retrieval, IEEE Trans. Image Process., 21, 4, 1452-1464 (2012) · Zbl 1381.62205 |
| [12] | Liu, G.; Wu, J.; Zhou, S., Probabilistic classifiers with a generalized Gaussian scale mixture prior, Pattern Recognit., 46, 1, 332-345 (2013) · Zbl 1248.68436 |
| [13] | Chang, S. G.; Yu, B.; Vetterli, M., Adaptive wavelet thresholding for image denoising and compression, IEEE Trans. Image Process., 9, 9, 1532-1546 (2000) · Zbl 0962.94028 |
| [14] | Kasaei, S.; Deriche, M.; Boashash, B., A novel fingerprint image compression technique using wavelets packets and pyramid lattice vector quantization, IEEE Trans. Image Process., 11, 12, 1365-1378 (2002) |
| [15] | Moulin, P.; Liu, J., Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity schemes, IEEE Trans. Inf. Theory, 45, 3, 909-919 (1999) · Zbl 0945.94004 |
| [16] | Bazi, Y.; Bruzzone, L.; Melgani, F., An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images, IEEE Trans. Geosci. Remote Sens., 43, 4, 874-887 (2005) |
| [18] | Thanh, M. N.; Wu, Q. M.J.; Ahuja, S., An extension of the standard mixture model for image segmentation, IEEE Trans. Neural Netw., 21, 8, 1326-1338 (2010) |
| [19] | Rudin, W., Real and Complex Analysis (1987), McGraw-Hill: McGraw-Hill New York · Zbl 0925.00005 |
| [20] | Farag, A. A.; ElBaz, A. S.; Gimelfarb, G., Precise segmentation of multimodal images, IEEE Trans. Image Process., 15, 4, 952-968 (2006) |
| [21] | Hedelin, P.; Skoglund, J., Vector quantization based on Gaussian mixture models, IEEE Trans. Speech Audio Process., 8, 4, 385-401 (2000) |
| [22] | Lindblom, J.; Samuelsson, J., Bounded support Gaussian mixture modeling of speech spectra, IEEE Trans. Speech Audio Process., 11, 1, 88-99 (2003) |
| [23] | Huber, P. J., Robust Statistics, 43-44 (1981), Wiley: Wiley New York · Zbl 0536.62025 |
| [24] | Ashburner, J.; Friston, K. J., Unified segmentation, NeuroImage, 26, 3, 839-851 (2005) |
| [27] | Muller, H.; Stadtmuller, U., Multivariate boundary kernels and a continuous least squares principle, J. R. Stat. Soc. Ser. B, 61, 2, 439-458 (1999) · Zbl 0927.62035 |
| [28] | Robert, J. S., Irrational Exuberance (2005), Princeton University Press: Princeton University Press Princeton, New Jersey |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
