Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  2009, Vol. 10 Issue (12): 1759-1768    DOI: 10.1631/jzus.A0820856
Computer Science and Technology     
Image interpretation: mining the visible and syntactic correlation of annotated words
Ding-yin XIA, Fei WU, Wen-hao LIU, Han-wang ZHANG
School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
Download:     PDF (0 KB)     
Export: BibTeX | EndNote (RIS)      

Abstract  Automatic web image annotation is a practical and effective way for both web image retrieval and image understanding. However, current annotation techniques make no further investigation of the statement-level syntactic correlation among the annotated words, therefore making it very difficult to render natural language interpretation for images such as “pandas eat bamboo”. In this paper, we propose an approach to interpret image semantics through mining the visible and textual information hidden in images. This approach mainly consists of two parts: first the annotated words of target images are ranked according to two factors, namely the visual correlation and the pairwise co-occurrence; then the statement-level syntactic correlation among annotated words is explored and natural language interpretation for the target image is obtained. Experiments conducted on real-world web images show the effectiveness of the proposed approach.

Key wordsWeb image annotation      Visibility      Pairwise co-occurrence      Natural language interpretation     
Received: 11 December 2008     
CLC:  TP37  
  TP391  
Cite this article:

Ding-yin XIA, Fei WU, Wen-hao LIU, Han-wang ZHANG. Image interpretation: mining the visible and syntactic correlation of annotated words. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(12): 1759-1768.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.A0820856     OR     http://www.zjujournals.com/xueshu/zjus-a/Y2009/V10/I12/1759

[1] RUAN Xiao-yu, ZHANG Hui, YONG Jun-hai. Visible region extraction from a sequence of rational Bézier surfaces[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(7 ): 17-.