×

Integrated probability function and its application to content-based image retrieval by relevance feedback. (English) Zbl 1047.68621

Summary: In the last few years, we have seen an upsurge of interest in content-based image retrieval – the selection of images from a collection via features extracted from images themselves. Often, a single image attribute may not have enough discriminative information for successful retrieval. On the other hand when multiple features are used, it is hard to determine the suitable weighing factors for various features for optimal retrieval. In this paper, we present a relevance feedback framework with Integrated Probability Function (IPF) which combines multiple features for optimal retrieval. The IPF is based on a new posterior probability estimator and a novel weight updating approach. We perform experiments on 1400 monochromatic trademark images have been performed. The proposed IPF is shown to be more effective and efficient to retrieve deformed trademark images than the commonly used integrated dissimilarity function. The new posterior probability estimator is shown to be generally better than the existing one. The proposed novel weight updating approach by relevance feedback is shown to be better than both the existing scoring approach and the existing ratio approach. In experiments, 95% of the targets are ranked at the top five positions. By two iterations of relevance feedback, retrieval performance can be improved from 75% to over 95%. The IPF and its relevance feedback framework proposed in this paper can be effectively and efficiently used in content-based image retrieval.

MSC:

68T10 Pattern recognition, speech recognition
68P20 Information storage and retrieval of data
Full Text: DOI

References:

[1] Del Bimbo, A., Visual Information Retrieval (1999), Morgan Kaufmann Publishers: Morgan Kaufmann Publishers Los Altos, CA
[2] C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, W. Equitz, Efficient and effective querying by image content. J. Intell. Inform. Systems 3 (3/4) (1994) 231-262.; C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, W. Equitz, Efficient and effective querying by image content. J. Intell. Inform. Systems 3 (3/4) (1994) 231-262.
[3] Eakins, J. P.; Boardman, J. M.; Graham, M. E., Similarity retrieval of trademark images, IEEE Multimedia, 5, 2, 53-63 (1998)
[4] C.P. Lam, J.K. Wu, B. Mehtre, STAR-A system for trademark archival and retrieval, in: Proceedings of the Second Asian Conference on Computer Vision, Vol. 3, 1995, pp. 214-217.; C.P. Lam, J.K. Wu, B. Mehtre, STAR-A system for trademark archival and retrieval, in: Proceedings of the Second Asian Conference on Computer Vision, Vol. 3, 1995, pp. 214-217.
[5] Y.S. Kim, W.Y. Kim, Content-based trademark retrieval system using visually salient feature, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997, pp. 307-312.; Y.S. Kim, W.Y. Kim, Content-based trademark retrieval system using visually salient feature, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997, pp. 307-312.
[6] Jain, A. K.; Vailaya, A., Shape-based retrievala case study with trademark image databases, Pattern Recognition, 31, 9, 1369-1390 (1998)
[7] D.Y.M. Chan, I. King, Genetic algorithm for weights assignment in dissimilarity function for trademark retrieval, in: Proceedings of the Third International Conference on Visual Information and Information Systems (VISUAL’99), Lecture Notes in Computer Science, Vol. 1614, The Netherlands, Springer, Berlin, 1999, pp. 557-565.; D.Y.M. Chan, I. King, Genetic algorithm for weights assignment in dissimilarity function for trademark retrieval, in: Proceedings of the Third International Conference on Visual Information and Information Systems (VISUAL’99), Lecture Notes in Computer Science, Vol. 1614, The Netherlands, Springer, Berlin, 1999, pp. 557-565.
[8] Xu, Lei; Krzyzak, Adam; Y. Suen, Ching, Methods of combining multiple classifiers and their applications to handwriting recognition, IEEE Trans. System Man Cybernet., 22, 3, 418-435 (1992)
[9] Kittler, J.; Hatef, R.; Dubin, R. P.W.; Matas, J., On combining classifiers, IEEE Trans. Pattern Anal. Mach. Intell., 20, 3, 226-239 (1998)
[10] D.Y.M. Chan, I. King, Weight assignment in dissimilarity function for chinese script character image retrieval using genetic algorithm, in: Proceedings of The Fourth International Workshop on Information Retrieval with Asian Languages (IRAL’99), Academia Sinica, Taipei, Taiwan, 1999, pp. 55-62.; D.Y.M. Chan, I. King, Weight assignment in dissimilarity function for chinese script character image retrieval using genetic algorithm, in: Proceedings of The Fourth International Workshop on Information Retrieval with Asian Languages (IRAL’99), Academia Sinica, Taipei, Taiwan, 1999, pp. 55-62.
[11] C. Lundquist, D.A. Grossman, O. Frieder, Improving relevance feedback in the vector space model, in: Proceedings of the Sixth International Conference on Information and Knowledge Management, CIKM’97, LasVegas, Nevada, USA, November 1997, pp. 16-23.; C. Lundquist, D.A. Grossman, O. Frieder, Improving relevance feedback in the vector space model, in: Proceedings of the Sixth International Conference on Information and Knowledge Management, CIKM’97, LasVegas, Nevada, USA, November 1997, pp. 16-23.
[12] Y. Rui, T.S. Huang, S. Mehrotra, Content-based image retrieval with relevance feedback in MARS, in: Proceedings of IEEE International Conference on Image Processing, Santa Barbara, CA, October 1997, pp. 815-818.; Y. Rui, T.S. Huang, S. Mehrotra, Content-based image retrieval with relevance feedback in MARS, in: Proceedings of IEEE International Conference on Image Processing, Santa Barbara, CA, October 1997, pp. 815-818.
[13] Rui, Y.; Huang, T. S.; Ortega, M.; Mehrotra, S., Relevance feedbacka power tool for interactive content-based image retrieval, IEEE Trans. Circuits Systems Video Technol., 8, 5, 644-655 (1998)
[14] G. Ciocca, R. Schettini, Similarity retrieval of trademark images, in: Proceedings of the 10th International Conference on Image Analysis and Processing, Venice, Italy, September 27-29 1999, pp. 915-920.; G. Ciocca, R. Schettini, Similarity retrieval of trademark images, in: Proceedings of the 10th International Conference on Image Analysis and Processing, Venice, Italy, September 27-29 1999, pp. 915-920.
[15] Y. Rui, T.S. Huang, A novel relevance feedback technique in image retrieval, in: Proceedings ACM Multimedia ’99(Part2), Orlando, FL, USA, 1999, pp. 67-70.; Y. Rui, T.S. Huang, A novel relevance feedback technique in image retrieval, in: Proceedings ACM Multimedia ’99(Part2), Orlando, FL, USA, 1999, pp. 67-70.
[16] Z. Jin, I. King, X.Q. Li, Content-based image retrieval by relevance feedback, in: Proceedings of the Fourth International Conference on Visual Information Systems, Lecture Notes in Computer Science, Vol. 1929, Lyon, France, November 2-4 Springer, Berlin, 2000.; Z. Jin, I. King, X.Q. Li, Content-based image retrieval by relevance feedback, in: Proceedings of the Fourth International Conference on Visual Information Systems, Lecture Notes in Computer Science, Vol. 1929, Lyon, France, November 2-4 Springer, Berlin, 2000.
[17] J. Ashley, R. Barber, M. Flickner, J. Hafner, D. Lee, W. Niblack, D. Petkovic, Automatic and semiautomatic methods for image annotation and retrieval in qbic, in: Proceedings of Storage and Retrieval for Image and Video Database III, Vol. 2420, February 1995, pp. 24-35.; J. Ashley, R. Barber, M. Flickner, J. Hafner, D. Lee, W. Niblack, D. Petkovic, Automatic and semiautomatic methods for image annotation and retrieval in qbic, in: Proceedings of Storage and Retrieval for Image and Video Database III, Vol. 2420, February 1995, pp. 24-35.
[18] J.K. Wu, B.M. Mehtre, Y.J. Gao, Chian-Prong Lam, A. Desai Narasimhalu, STAR-A multimedia database system for trademark registration, in: W. Litwin, T. Risch (Eds.), Applications of Databases, First International Conference, Lecture Notes in Computer Science, Vol. 819, Vadstena, Sweden, 21-23 June 1994, Springer, Berlin, pp. 109-122.; J.K. Wu, B.M. Mehtre, Y.J. Gao, Chian-Prong Lam, A. Desai Narasimhalu, STAR-A multimedia database system for trademark registration, in: W. Litwin, T. Risch (Eds.), Applications of Databases, First International Conference, Lecture Notes in Computer Science, Vol. 819, Vadstena, Sweden, 21-23 June 1994, Springer, Berlin, pp. 109-122.
[19] Mehtre, B. M.; Kankanhalli, M. S.; Lee, W. F., Shape measures for content based image retrievala comparison, Inform. Process. Manage., 33, 3, 319-337 (1997)
[20] Mehtre, B. M.; Kankanhalli, M. S.; Lee, W. F., Content-based image retrieval using a composite color-shape approach, Inform. Process. Manage., 34, 1, 109-120 (1998)
[21] F. Mokhtarian, S. Abbasi, J. Kittler, Efficient and robust retrieval by shape content through curvature scale space, in: First International Workshop on Image Databases and Multi-Media Search, Amsterdam, The Netherlands, August 1996, pp. 35-42.; F. Mokhtarian, S. Abbasi, J. Kittler, Efficient and robust retrieval by shape content through curvature scale space, in: First International Workshop on Image Databases and Multi-Media Search, Amsterdam, The Netherlands, August 1996, pp. 35-42.
[22] M.E.J. Wood, N.W. Campbell, B.T. Thomas, Iterative refinement by relevance feedback in content-based digital image retrieval, in: Proceedings ACM Multimedia’98, Bristol, UK, September 1998, pp. 13-18.; M.E.J. Wood, N.W. Campbell, B.T. Thomas, Iterative refinement by relevance feedback in content-based digital image retrieval, in: Proceedings ACM Multimedia’98, Bristol, UK, September 1998, pp. 13-18.
[23] S. Alwis, J. Austin, An integrated framework for trademark image retrieval using gestalt features and CMM neural network, in: Proceedings of the Seventh International Conference on Image Processing and its Applications, Vol. 1, University of Manchester, UK, July 13-15 1999, pp. 290-295.; S. Alwis, J. Austin, An integrated framework for trademark image retrieval using gestalt features and CMM neural network, in: Proceedings of the Seventh International Conference on Image Processing and its Applications, Vol. 1, University of Manchester, UK, July 13-15 1999, pp. 290-295.
[24] Hu, M. K., Visual pattern recognition by moment invariants, IRE Trans. Inform. Theory, 8, 179-187 (1962) · Zbl 0102.13304
[25] B. Jahne, Digital Image Processing: Concepts, Algorithms and Scientific Applications, 4th Edition, Springer, Berlin, New York, 1997.; B. Jahne, Digital Image Processing: Concepts, Algorithms and Scientific Applications, 4th Edition, Springer, Berlin, New York, 1997. · Zbl 0880.68137
[26] Teh, Cho-Huak; T Chin, R., On image analysis by the methods of moments, IEEE Trans. Pattern Anal. Mach. Intell., 10, 4, 496-513 (1998) · Zbl 0709.94543
[27] Liao, S. X.; Pawlak, M., On image analysis by moments, IEEE Trans. Pattern Anal. Mach. Intell., 18, 3, 254-266 (1996)
[28] Bailey, R. R.; Srinath, M., Orthogonal moment features for use with parametric and non-parametric classifiers, IEEE Trans. Pattern Anal. Mach. Intell., 18, 4, 389-398 (1996)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.