Content-Based Image Retrieval: A Comparison between Query by Example and Image Browsing Map Approaches

Abstract

Efficient and effective retrieval techniques of images are desired because of the explosive growth of digital images. Content-based image retrieval is a promising approach because of its automatic indexing and retrieval based on their semantic features and visual appearance. The similarity of images depends on the feature representation and feature dissimilarity function. However, users have difficulties in representing their information needs in queries to content-based image retrieval systems. In this paper, we investigate two approaches, query by example and image browsing map. Activities to support the information seeking behavior are analyzed. The performance of these approaches is measured by a user evaluation. It is found that the image browsing map provides more functionalities and capabilities to support the features of information seeking behavior and produces better performance in searching images.

Keywords

digital images content based image retrieval search strategies query by example image browsing maps information seeking behaviour user evaluation retrieval performance

Get full access to this article

View all access options for this article.

References

[1] C.M. Brown , Information seeking behavior of scientists in the electronic information age: astronomers, chemists, mathematicians, and physicists , Journal of the American Society for Information Science and Technology 50(10) (1999) 929-943 .

[2] C.C. Chen and C.C. Chen , Filtering methods for texture discrimination , Pattern Recognition Letters 20(8) (1999) 783-790 .

[3] H. Chen , An analysis of image queries in the field of art history , Journal of the American Society for Information Science and Technology 52(3) (2001) 260-273 .

[4] Z. Chen , W. Liu , F. Zhang , M. Li and H. Zhang , Web mining for web image retrieval , Journal of the American Society for Information Science and Technology 52(10) (2001) 831-839 .

[5] Y. Choi and E.M. Rasmussen , Searching for images: the analysis of users’ queries for image retrieval in American history , Journal of the American Society for Information Science and Technology 54(6) (2003) 498-511 .

[6] H. Chu , Research in image indexing and retrieval as reflected in the literature , Journal of the American Society for Information Science and Technology 52(12) (2001) 1011-1018 .

[7] CIE, Colorimetry, CIE Publication No. 15.2 (Bureau Central de la CIE, Vienna, 1986).

[8] L.Z. Cooper , A case study of information seeking behavior in 7-year-old children in a semi-structured situation , Journal of the American Society for Information Science and Technology 53(11) (2002) 904-922 .

[9] E.T. Dresang , More research needed: informal information seeking behavior of youth on the Internet , Journal of the American Society for Information Science and Technology 50(12) (1999) 1123-1124 .

10.

[10] D. Ellis, The Derivation of a Behavior Model for Information Retrieval System, (PhD, Dissertation, University of Sheffield, United Kingdom, 1987).

11.

[11] D. Ellis , A behavioral approach to information retrieval system design , Journal of Documentation 45(2) (1989) 171-212 .

12.

[12] M. Flickner , H. Sawhney and W. Niblack , Query by image and video content: the QBIC system , IEEE Computer September (1995) 23-32 .

13.

[13] C. Frankel, M. Swain and V. Athitsos, Webseer: An Image Search Engine for the World Wide Web, technical report TR-96-14 (CS Department, University of Chicago, 1996).

14.

[14] A.A. Goodrum , M.E. Rorvig , K. Jeong and C. Suresh , An open source agenda for research linking text and image content features , Journal of the American Society for Information Science and Technology 52(11) (2001) 948-953 .

15.

[15] J. Hafner , H.S. Sawhney , W. Equitz , M. Flicker and W. Niblack , Efficient color histogram indexing for quadratic form distance functions , IEEE Transactions on Pattern Analysis and Machine Intelligence 17(7) (1995) 729-736 .

16.

[16] T. Kohonen , Self-Organization and Associative Memory ( Springer, Berlin , 1988).

17.

[17] M. La Cascia , S. Sethi and S. Sclaroff , Combining textual and visual cues for content-based image retrieval on the world wide web . In: Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, Santa Barbara, California, (IEEE Computer Society, 1998) 24-28 .

18.

[18] M. Lee and C. Pun , Rotation and scale invariant wavelet feature for content-based texture image retrieval , Journal of the American Society for Information Science and Technology 54(1) (2003) 68-80 .

19.

[19] W.Y. Ma and B.S. Manjunath , NeTra: a toolbox for navigating large image databases , Multimedia Systems 7(3) (1999) 184-198 .

20.

[20] B.S. Manjunath and W.Y. Ma , Texture features for browsing and retrieval of image data , IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(18) (1996) 837-842 .

21.

[21] L.I. Meho and H.R. Tibbo , Modeling the information seeking behavior of social scientists: Ellis’s study revisited , Journal of the American Society for Information Science and Technology 54(6) (2003) 570-587 .

22.

[22] W. Niblack , R. Barber , W. Equitz , M. Flickner , E. Glasman , D. Petkovic , P. Yanker , C. Faloutsos and G. Taubin , The QBIC project: querying images by content using colors, texture and shape . In: W. Niblack (ed.), SPIE Proceedings Vol. 1908, Storage and Retrieval for Image and Video Databases, 2-3 February 1993, San Jose, California (SPIE, San Jose, 1993) 3173-3187 .

23.

[23] A. Pentland , R. Picard and S. Sclaroff , Photobook: content-based manipulation of image databases. Storage and Retrieval for Image and Video Databases II, number 2185, San Jose, CA. , February 1994.

24.

[24] M. Swain and D. Ballard , Color indexing , International Journal of Computer Vision 7(1) (1991) 11-32 .

25.

[25] M. Swain , Searching for Multimedia on the World Wide Web, technical report CRL 99/1, Cambridge Research Laboratory (1999). Available at: http://crl.research.compaq.com/publications/techreports/abstracts/99_1.html.

26.

[26] J.R. Smith, Integrated Spatial and Feature Image Systems: Retrieval, Analysis and Compression (PhD thesis, Graduate School of Arts and Science, Columbia University, 1997).

27.

[27] J.R. Smith , Quantitative assessment of image retrieval effectiveness , Journal of the American Society for Information Science and Technology, 52(11) (2001) 969-979 .

28.

[28] E. Whitmire , Disciplinary differences and undergraduates’ information seeking behavior , Journal of the American Society for Information Science and Technology 53(8) (2002) 631-638 .

29.

[29] Q. Wu , S.S. Iyengar and M. Zhu , Web image retrieval using self-organizing feature map , Journal of the American Society for Information Science and Technology 52(10) (2001) 868-875 .

30.

[30] C.C. Yang and S.H. Kwok , Efficient gamut clipping for color image processing using LHS and YIQ , Optical Engineering, 42(3) (2003) 701-711 .

31.

[31] C.C. Yang , S.H. Kwok and M.K. Yip , Image Browsing of Feature-based Products , Proceedings of the SPIE International Conference on Electronic Imaging and Multimedia Technology, Photonics Asia, Shanghai, China, October 14-18, 2002

32.

[32] C.C. Yang and M.K. Yip , Quantization of color histograms using GLA , Proceedings of the SPIE International Conference on Electronic Imaging and Multimedia Technology, Photonics Asia, Shanghai, China, October 14-18, 2002.

33.

[33] C.C. Yang and M.K. Yip , Visual thesaurus for color image retrieval using self-organizing map , Proceedings of the 7th International Conference on Information Systems Analysis and Synthesis, Orlando, July 22-25, 2001.

34.

[34] J. Zachary , S.S. Iyengar and J. Barhen , Content based image retrieval and information theory: a general approach , Journal of the American Society for Information Science and Technology 52(10) (2001) 840-852 .

35.

[35] J. Zachary and S.S. Iyengar , Information theoretic similarity measures for content based image retrieval , Journal of the American Society for Information Science and Technology 52(10) (2001) 856-867 .