Symmetry based 3D flower modeling using single-image
MIAO Yongwei1, LIU Lili1, ZHANG Xudong1, LIU Zhen2
1. College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China;
2. College of Science, Zhejiang University of Technology, Hangzhou 310023, China
Abstract:Based on the common symmetry properties of natural flowers, an interactive approach is proposed in this paper for modeling 3D flower using a single floral image. Firstly, the user interactively sketches two edge lines of each flower petal on the input single image. A cone then can be constructed by least squares fitting on the top and bottom sample points of the edge lines. Thus, the symmetry plane of each petal can be determined by the fitted cone. Further, the depth information of the couple edge lines on each petal can also be calculated with respect to the inherent symmetry properties of different kinds of flowers and their symmetry planes. Using the 3D constructive curves, each petal model can be generated as a triangular mesh, and the whole 3D flower model can be obtained. Finally, according to the texture information of the input image, the realistic flower model can be created by synthesizing the flower texture. Experimental results illustrate that our modeling scheme for 3D flowers can recover the depth information effectively and create the whole flower structure accurately, which can generate the 3D realistic flower models in a convenient manner.
[1] FRANCON J. The algorithmic beauty of plants[J]. Plant Science,1997,122(1):109-110.
[2] PRUSINKIEWICZ P, HAMMEL M, HANAN J, et al. L-systems:From the theory to visual models of plants[C]//Proceedings of the 2nd CSIRO Symposium on Computational Challenges in Life Sciences,1996(3):1-32.
[3] LONGAY S, RUNIONS A, BOUDON F, et al. TreeSketch:Interactive procedural modeling of trees on a tablet[C]//Proceedings of Eurographics Symposium on Sketch-based Interfaces & Modeling. Switzerland:Eurographics Association, 2012:107-120.
[4] LINTERMANN B, DEUSSEN O. A modelling method and user interface for creating plants[J]. Computer Graphics Forum,1998,17(1):73-82.
[5] 刘彦宏,王洪斌,杜威,等.基于图像的树类物体的三维重建[J].计算机学报,2002,25(9):930-935. LIU Yanhong, WANG Hongbin, DU Wei, et al. Image-based 3D reconstruction of tree-like objects[J]. Chinese Journal of Computers,2002,25(9):930-935.
[6] PRUSINKIEWICZ P, NDERMANN L, KARWOWSKI R, et al. The use of positional information in the modeling of plants[C]//Conference on Computer Graphics and Interactive Techniques. New York:ACM,2001:289-300.
[7] IJIRI T, OWADA S, OKABE M, et al. Floral diagrams and inflorescences:Interactive flower modeling using botanical structural constraints[J]. ACM Transactions on Graphics, 2005,24(3):720-726.
[8] ENDRESS P K. Symmetry in flowers:Diversity and evolution[J]. International Journal of Plant Sciences, 1999,160(S6):3-23.
[9] IJIRI T, YOKOO M, KAWABATA S, et al. Surface-based growth simulation for opening flowers[C]//Graphics Interface 2008 Conference. Windsor:Canadian Information Processing Society Toronto,2008:227-234.
[10] LI J, LIU M, XU W, et al. Boundary-dominant flower blooming simulation[J]. Computer Animation & Virtual Worlds,2015,26(3/4):433-443.
[11] LIANG H, MAHADEVAN L. Growth, geometry, and mechanics of a blooming lily[J]. Proceedings of the National Academy of Sciences, 2011,108(14):5516-5521.
[12] RUDALL P J, BATEMAN R M. Evolution of zygomorphy in monocot flowers:Iterative patterns and developmental constraints[J]. New Phytologist, 2004,162(1):25-44.
[13] 李交昆,唐璐璐.花对称性的研究进展[J].生物多样性,2012,20(3):280-285. LI Jiaokun, TANG Lulu. Progress in the study of floral symmetry[J]. Biodiversity Science, 2012,20(3):280-285.
[14] HONG W, YANG A Y, HUANG K, et al. On symmetry and multiple-view geometry:Structure, pose, and calibration from a single image[J]. International Journal of Computer Vision, 2004,60(3):241-265.
[15] CORDIER F, SEO H, MELKEMI M, et al. Inferring mirror symmetric 3D shapes from sketches[J]. Computer-Aided Design, 2013,45(2):301-311.
[16] CORDIER F, SEO H, PARK J, et al. Sketching of mirror-symmetric shapes[J]. IEEE Transactions on Visualization & Computer Graphics, 2010,17(11):1650-1662.
[17] ÖZTIRELI A, UYUMAZ U, POPA T, et al. 3D modeling with a symmetric sketch[C]//Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling. New York:ACM Press,2011:23-30.
[18] TEVS A, HUANG Q, WAND M, et al. Relating shapes via geometric symmetries and regularities[J]. ACM Transactions on Graphics, 2014,33(4):Article No. 119.
[19] MIAO Y, HU F, ZHANG X, et al. SymmSketch:Creating symmetric 3D free-form shapes from 2D sketches[J]. Journal of Computational Visual Media, 2015,1(1):3-16.
[20] JIANG N J, TAN P, CHEONG L F. Symmetric architecture modeling with a single image[J]. ACM Transactions on Graphics, 2009, 28(5):Article No. 113.
[21] ZHANG C, YE M, FU B, et al. Data-driven flower petal modeling with botany priors[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus:IEEE, 2014:636-643.
[22] YAN F, GONG M, COHEN-OR D, et al. Flower reconstruction from a single photo[J]. Computer Graphics Forum, 2014,33(2):439-447.
[23] ANDRE A, SAITO S. Single-view sketch based modeling[C]//Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling. New York:ACM Press, 2011:133-140.
[24] IGARASHI T, MATSUOKA S, TANAKA H. Teddy:A sketching interface for 3D freeform design[J]. ACM Transactions on Graphics, 2007,26(3):Article No. 21.
[25] IJIRI T, OWADA S, IGARASHI T. Seamless integration of initial sketching and subsequent detail editing in flower modeling[J]. Computer Graphics Forum, 2006,25(3):617-624.
[26] 宋成芳,彭群生,丁子昂,等.基于草图的花开建模与动画[J].软件学报,2007,18(增刊):45-53. SONG Chengfang, PENG Qunsheng, DING Zi'ang, et al. Sketch-based modeling and animation of floral blossom[J]. Journal of Software, 2007,18(Supp):45-53.
[27] 葛娟,周炜,刘浏,等.结合法向聚类的大叶片植物重建[J].计算机辅助设计与图形学学报,2010,22(11):1940-1944. GE Juan, ZHOU Wei, LIU Liu, et al. Large-leaf-plant modeling with normal direction clustering[J]. Journal of Computer-Aided Design & Computer Graphics, 2010,22(11):1940-1944.
[28] TAN P, ZENG G, WANG J, et al. Image-based tree modeling[J]. ACM Transactions on Graphics, 2007,26(3):Article No. 43.
[29] TAN P, FANG T, XIAO J, et al. Single image tree modeling[J]. ACM Transactions on Graphics, 2008,27(5):Article No. 108.
[30] 缪永伟,胡非夏,冯小红,等.基于单幅图像的三维对称自由形体重建[J].计算机辅助设计与图形学学报,2015,27(9):1637-1647. MIAO Yongwei, HU Feixia, FENG Xiaohong, et al. Single image based 3D symmetric free-form objects reconstruction[J]. Journal of Computer-Aided Design & Computer Graphics, 2015,27(9):1637-1647.