Please wait a minute...
J4  2009, Vol. 43 Issue (12): 2129-2135    DOI: 10.3785/j.issn.1008-973X.2009.12.001
自动化技术、计算机技术     
使用加权图像标注改进Web图像检索
黄鹏,陈纯,王灿,卜佳俊,陈伟,仇光
(浙江大学 浙江省服务机器人重点实验室,计算机科学与技术学院,浙江 杭州 310027)
Improved Web image retrieval by weighted image annotations
HUANG Peng, CHEN Chun, WANG Can, BU Jia-jun, CHEN  Wei, QIU Guang
(Zhejiang Key Laboratory of Service Robot, Zhejiang University, Hangzhou 310027, China)
 全文: PDF(1044 KB)   HTML
摘要:

为了提高Web图像的检索质量,提出了一种融合文本关键字和图像视觉内容的Web图像检索方法.通过改进的图像自动标注模型,将Web图像本身所蕴含的低层视觉特征映射到图像高层语义特征,即图像文本标注;再将词汇相似性计算技术作为语义信息的度量手段,将图像文本标注转换成带有权重的文本标注;利用贝叶斯推理网检索模型内在的多信息融合能力,将带权重的Web图像文本标注特征和Web文档中的文本信息无缝地融合在一起实现Web图像检索.实验结果表明,将Web中的文本关键字和Web图像视觉内容融合起来可在一定程度上提高Web图像检索质量.

Abstract:

A Web image retrieval method was proposed which combines textual terms extracted from Web documents and image contents in order to improve Web image retrieval.  Web  image contents were translated into image annotations by the improved automatic image annotation model. Then the technology of term similarity measurement, as the metric form of  semantic information, was applied to weighting image annotations. These annotations and some terms extracted from Web documents were introduced into Web image retrieval under  the framework of Bayesian  inference network which has an inherent fusion capability of multiple information sources. Experimental results show that the  method improves image  retrieval to some extent by combining Web image contents and terms in Web documents.

出版日期: 2010-01-16
:  TP 391.41  
基金资助:

国家科技支撑计划资助项目(2008BAH26B00) ;浙江省优先主题社会发展资助项目(2007C13019).

通讯作者: 王灿,男,讲师.     E-mail: wcan@zju.edu.cn
作者简介: 黄鹏(1979-),男,江西上高人,博士生,从事自然语言处理、图像处理、Web检索研究.
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  

引用本文:

黄鹏, 陈纯, 王灿, 等. 使用加权图像标注改进Web图像检索[J]. J4, 2009, 43(12): 2129-2135.

HUANG Feng, CHEN Chun, WANG Can, et al. Improved Web image retrieval by weighted image annotations. J4, 2009, 43(12): 2129-2135.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2009.12.001        http://www.zjujournals.com/eng/CN/Y2009/V43/I12/2129

[1] RUI Y, HUANG T S, CHANG S F. Image retrieval: current techniques, promising directions and open issues[J]. Journal of Visual Communication and Image Representation, 1999, 10(1): 39-62.
[2] SMEULDERS A W M, WORRING M, SANTINI S, et al. Content-based image retrieval at the end of the early years[J]. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 2000, 22(12):1349-1380.
[3] MONAY F, GATICA-PEREZ D. On image auto-annotation with latent space models[C]∥ Proceedings of the 11th ACM International Conference on Multimedia. New York, USA: ACM, 2003:275-278.
[4] MORI Y, TAKAHASHI H, OKA R. Image-to-word transformation based on dividing and vector quantizing images with words[C]∥ 1st International Workshop on Multimedia Intelligent Storage and Retrieval Management. USA: [s. n], 1999.
[5] DUYGULU P, BARNARD K, FREITAS N, et al. Object recognition as machine translation: learning a lexicon for a fixed image vocabulary[C]∥Proceedings of the 7th European Conference on Computer Vision-Part IV. London, UK: Springer-Verlag, 2002:97-112.
[6] LI J, WANG J Z. Automatic linguistic indexing of pictures by a statistical modeling approach[J]. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 2003, 25(9):1075-1088.
[7] CUSANO C, CIOCCA G, SCHETTINI R. Image annotation using SVM[C]∥ Proceedings of SPIE. San Jose, CA,USA:SPIE, 2004, 5304: 330-338.
[8] JEON J, LAVRENKO V, MANMATHA R. Automatic image annotation and retrieval using cross-media relevance models[C]∥Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Canada: ACM, 2003:119-126.
[9] lAVRENKO V, MANMATHA R, JEON J. A model for learning the semantics of pictures[C]∥Proceedings of Advance in Neutral Information Processing. Cambridge, MA: MIT, 2003:100-107.
[10] JIN Y, KHAN L, WANG L, et al. Image annotations by combining multiple evidence&WordNet[C]∥Proceedings of the 13th Annual ACM International Conference on Multimedia. Singapore: ACM, 2005:706-715.
[11] GHOSHAL A, IRCING P, KHUDANPUR S. Hidden Markov models for automatic annotation and content-based retrieval of images and video[C] ∥Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Salvador, Brazil: ACM, 2005:544-551.
[12] FENG S L, MANMATHA R, LAVRENKO V. Multiple Bernoulli relevance models for image and video annotation[C]∥Computer Vision and Pattern Recognition, 2004. CVPR 2004. University, Amherst, MA, USA: IEEE CS, 2004:1002-1009.
[13] JIANG J J, CONTATH D W. Semantic similarity based on corpus statistics and lexical taxonomy[C]∥Proceedings of International Conference on Research in Computational Linguistics. Taiwan: [s. n.], 1997:1933.
[14] FELLBAUM C.WordNet: an electronic lexical database[M]. USA Cambridge City: MIT Press, 1998.
[15] PEARL J. Probabilistic reasoning in intelligent systems: networks of plausible inference [M]. San Francisco, CA, USA: Morgan Kaufmann Publishers, 1988.
[16] TURTLE H, CROFT W B. Evaluation of an inference network-based retrieval model[J]. ACM Transactions on Information Systems (TOIS), 1991,9(3):187-222.
[17] BAEZA-YATES R, RIBEIRO-NETO B. Modern information retrieval[M]. England: Addison-Wesley Harlow Press, 1999.
[1] 杨玉婷, 史玉回, 夏顺仁. 基于讨论机制的头脑风暴优化算法[J]. J4, 2013, 47(10): 1705-1711.
[2] 朱晓恩, 郝欣, 夏顺仁. 基于Levy flight的特征选择算法[J]. J4, 2013, 47(4): 638-643.
[3] 孙创日,甄帅,夏顺仁. 基于吸引区域的多模态脑磁共振图像仿射配准[J]. J4, 2012, 46(9): 1722-1728.
[4] 谢迪, 童若锋, 唐敏, 冯阳. 具有高区分度的视频火焰检测方法[J]. J4, 2012, 46(4): 698-704.
[5] 戴渊明, 韦巍, 林亦宁. 基于颜色纹理特征的均值漂移目标跟踪算法[J]. J4, 2012, 46(2): 212-217.
[6] 李启雷, 金文光, 耿卫东. 基于无线惯性传感器的人体动作捕获方法[J]. J4, 2012, 46(2): 280-285.
[7] 刘晨彬,潘颖,张海石,黄峰平,夏顺仁. 基于磁共振图像的脑瘤MGMT表达状况检测算法[J]. J4, 2012, 46(1): 170-176.
[8] 钱诚, 张三元. 适用于目标跟踪的加权增量子空间学习算法[J]. J4, 2011, 45(12): 2240-2246.
[9] 吕谷来, 李建平, 李锵, 俞利兴, 朱松明, 楼建忠, 袁祎琳. 基于机器视觉的砧木定位识别方法[J]. J4, 2011, 45(10): 1766-1770.
[10] 曹颖, 郝欣, 朱晓恩, 夏顺仁. 基于自动随机游走的乳腺肿块分割算法[J]. J4, 2011, 45(10): 1753-1760.
[11] 赖小波,朱世强. 基于互相关信息的非参数变换立体匹配算法[J]. J4, 2011, 45(9): 1636-1642.
[12] 刘建明, 鲁东明, 葛蓉. 基于全局优化的图像修复及其在GPU上实现[J]. J4, 2011, 45(2): 247-252.
[13] 王金德, 寿黎但, 李晓燕, 陈刚. 基于多重分割捆绑特征的目标图像检索[J]. J4, 2011, 45(2): 259-266.
[14] 梁文锋,项志宇. 鲁棒的PTZ摄像机目标跟踪算法[J]. J4, 2011, 45(1): 59-63.
[15] 战江涛,刘强,柴春雷. 基于三维模型与Gabor小波的人脸特征点跟踪方法[J]. J4, 2011, 45(1): 30-36.