Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2010, Vol. 11 Issue (11): 850-859    DOI: 10.1631/jzus.C1001004
Articles     
Salient object extraction for user-targeted video content association
Jia Li, Han-nan Yu, Yong-hong Tian, Tie-jun Huang, Wen Gao
Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China, Graduate University of Chinese Academy of Sciences, Beijing 100049, China, National Engineering Lab for Video Technology (NELVT), School of EE & CS, Peking University, Beijing 100871, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  The increasing amount of videos on the Internet and digital libraries highlights the necessity and importance of interactive video services such as automatically associating additional materials (e.g., advertising logos and relevant selling information) with the video content so as to enrich the viewing experience. Toward this end, this paper presents a novel approach for user-targeted video content association (VCA). In this approach, the salient objects are extracted automatically from the video stream using complementary saliency maps. According to these salient objects, the VCA system can push the related logo images to the users. Since the salient objects often correspond to important video content, the associated images can be considered as content-related. Our VCA system also allows users to associate images to the preferred video content through simple interactions by the mouse and an infrared pen. Moreover, by learning the preference of each user through collecting feedbacks on the pulled or pushed images, the VCA system can provide user-targeted services. Experimental results show that our approach can effectively and efficiently extract the salient objects. Moreover, subjective evaluations show that our system can provide content-related and user-targeted VCA services in a less intrusive way.

Key wordsSalient object extraction      User-targeted video content association      Complementary saliency maps     
Received: 14 September 2010      Published: 04 November 2010
CLC:  TP391.7  
Cite this article:

Jia Li, Han-nan Yu, Yong-hong Tian, Tie-jun Huang, Wen Gao. Salient object extraction for user-targeted video content association. Front. Inform. Technol. Electron. Eng., 2010, 11(11): 850-859.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C1001004     OR     http://www.zjujournals.com/xueshu/fitee/Y2010/V11/I11/850

[1] Yan-hong Liu, Juan Cao, Zhong-gui Chen, Xiao-ming Zeng. Ray-triangular Bézier patch intersection using hybrid clipping algorith[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(10): 1018-1030.
[2] Hao XIE,Ruo-feng TONG. Image meshing via hierarchical optimization[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(1): 32-40.
[3] Xiao Liu, Jia-min Liu, An-xi Cao, Zhuang-le Yao. HAPE3D—a new constructive algorithm for the 3D irregular packing problem[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(5): 380-390.
[4] Divya Udayan J, HyungSeok Kim, Jee-In Kim. An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(1): 12-27.
[5] Xiao-juan Duan, Guo-zhao Wang. Degree elevation of unified and extended spline curves[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(12): 1098-1105.
[6] Yong-wei Miao, Fei-xia Hu, Min-yan Chen, Zhen Liu, Hua-hao Shou. Visual salience guided feature-aware shape simplification[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(9): 744-753.
[7] Fei-wei Qin, Lu-ye Li, Shu-ming Gao, Xiao-ling Yang, Xiang Chen. A deep learning approach to the classification of 3D CAD models[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(2): 91-106.
[8] Lie-fu Ai, Jun-qing Yu, Yun-feng He, Tao Guan. High-dimensional indexing technologies for large scale content-based image retrieval: a review[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(7): 505-520.
[9] Xiao-hong Tan, Rui-min Shen, Yan Wang. Personalized course generation and evolution based on genetic algorithms[J]. Front. Inform. Technol. Electron. Eng., 2012, 13(12): 909-917.
[10] Shi-yan Wang, Hui-min Yu. Convex relaxation for a 3D spatiotemporal segmentation model using the primal-dual method[J]. Front. Inform. Technol. Electron. Eng., 2012, 13(6): 428-439.
[11] Juan Cao, Guo-zhao Wang. Non-uniform B-spline curves with multiple shape parameters[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(10): 800-808.
[12] Yu-lei Geng, Jin Wang, Guo-dong Lu, Zheng Liu, Gang Chen. Sketch based garment modeling on an arbitrary view of a 3D virtual human model[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(3): 195-203.
[13] Chun-luan Zhou, Jun Xiao. Cartoon capture by key-frame based contour tracking[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(1): 36-43.
[14] Wan-qiang Shen, Guo-zhao Wang. Triangular domain extension of linear Bernstein-like trigonometric polynomial basis[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(5): 356-364.
[15] Qian-qian Hu, Guo-jin Wang. Representing conics by low degree rational DP curves[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(4): 278-289.