Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)  2018, Vol. 52 Issue (3): 599-604    DOI: 10.3785/j.issn.1008-973X.2018.03.024
Artificial Intelligence and Graphics     
Interactive sculpture modeling based on mesh deformation in HMD VR environment
ZHU Xiao-qiang, YU Tao
School of Communication and Information, Institute of Smart City, Shanghai University, Shanghai 200444, China
Download:   PDF(2126KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A digital sculpture system in the HMD (head-mounted device) VR environment was proposed to let non-professional users create and edit 3D models. First of all, an initial 3D model was represented with half-edge topology, and the sculpture area was searched according to the brush position of the VR handles, which was accelerated by a spatial partition. In order to ensure a high-quality mesh shape and a robust sculpture process, the newly transformed vertices were sorted and re-localized. Finally, the mesh deformation was interactively calculated according to users' 3D inputs; the 2D manifold model with rich details was iteratively generated. Using the proposed system, the users and the virtual models are placed within the same 3D space, which can increase the modeling interactivity and reduce the difficulty. Therefore, even non-professionals can create complex 3D shapes quickly by procedural sculpture.



Received: 22 June 2017      Published: 11 September 2018
CLC:  TP391  
Cite this article:

ZHU Xiao-qiang, YU Tao. Interactive sculpture modeling based on mesh deformation in HMD VR environment. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(3): 599-604.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2018.03.024     OR     http://www.zjujournals.com/eng/Y2018/V52/I3/599


头戴设备VR环境下基于网格变形的交互雕刻建模

为满足非专业用户的3D模型生成和编辑需求,提出一种在头戴设备VR环境下的数字雕刻系统.对初始化的三维模型进行半边结构拓扑表示,根据VR交互手柄的笔刷位置和空间划分来高效查询网格雕刻区域;对待雕刻顶点按法向变形以生成新模型,为保证得到高质量网格形状和鲁棒雕刻过程,对新移动的顶点所在边长进行排序并重新局部网格化;对用户的三维输入实时反馈变形并迭代生成具有丰富细节的二维流形模型.借助本文系统,将用户与所雕刻模型置于同一三维空间,增加了建模交互性,降低了建模难度,即使非专业建模人员也能快速实时雕刻生成复杂三维模型.

[1] PICK S, WEYERS B, HENTSCHEL B, et al. Design and evaluation of data annotation workflows for CAVE-like virtual environments[J].IEEE Transactions on Visualization and Computer Graphics, 2016, 22(4):1452-1461.
[2] 冯志全, 梁丽伟, 徐涛, 等. 虚拟装配交互界面中的隐式交互算法研究[J]. 计算机辅助设计与图形学学报, 2017, 29(10):1952-1962. FENG Zhi-quan, LIANG Li-wei, XU Tao, et al. Research on implicit interaction in virtual assembly interactive interface[J].Journal of Computer-Aided Design & Computer Graphics, 2017, 29(10):1952-1962.
[3] 刘慧, 冯志全, 梁丽伟, 等. 虚拟界面自然交互模型和算法[J]. 浙江大学学报:工学版, 2016, 50(6):1168-1175. LIU Hui, FENG Zhi-quan, LIANG Li-wei, et al. Natural interaction model and algorithm based on virtual interface[J].Journal of Zhejiang University:Engineering Science, 2016, 50(6):1168-1175.
[4] 周小龙, 汤帆扬, 管秋, 等. 基于3D人眼模型的视线跟踪技术综述[J]. 计算机辅助设计与图形学学报, 2017, 29(9):1579-1589. ZHOU Xiao-long, TANG Fan-yang, GUAN Qiu, et al. A survey of 3D eye model based gaze tracking[J].Journal of Computer-Aided Design and Computer Graphics, 2017, 29(9):1579-1589.
[5] 程时伟, 陆煜华, 蔡红刚. 移动设备眼动跟踪技术[J]. 浙江大学学报:工学版, 2016, 50(6):1160-1167. CHENG Shi-wei, LU Yu-hua, CAI Hong-gang. Mobile device based eye tracking technology[J].Journal of Zhejiang University:Engineering Science, 2016, 50(6):1160-1167.
[6] KOULIERIS G A, BUI B, BANKS M S, et al. Accommodation and comfort in head-mounted displays[J].ACM Transactions on Graphics, 2017, 36(4):87:1-87:11.
[7] KONRAD R, PADMANABAN N, MOLNER K, et al. Accommodation-invariant computational near-eye displays[J].ACM Transactions on Graphics, 2017, 36(4):88:1-88:12.
[8] 肖翱, 徐枫, 雍俊海, 等. 针对虚拟现实眼镜的近/远视反卷积矫正算法[J]. 计算机辅助设计与图形学学报, 2017, 29(7):1169-1176. XIAO Ao, XU Feng, YONG Jun-hai, et al. A fast deconvolution algorithm for correcting myopia/hyperopia in head mounted display[J].Journal of Computer-Aided Design and Computer Graphics, 2017, 29(7):1169-1176.
[9] WESCHE G, SEIDEL H P. Freedrawer:a free-form sketching system on the responsive workbench[C]//Proceedings of the ACM Symposium on Virtual Reality Software and Technology. Alberta:ACM, 2001:167-174.
[10] KEEFE D F, FDLIZ D A, MOSCOVICH T, et al. Cavepainting:a fully immersive 3D artistic medium and interactive experience[C]//Proceedings of the Symposium on Interactive 3D Graphics. North Carolina:ACM, 2001:85-93.
[11] KEEFE D F, ZELEZNIK R C, LAIDLAW D H. Drawing on air:input techniques for controlled 3D line illustration[J]. IEEE Transactions on Visualization and Computer Graphics, 2007, 13(5):1067-1081.
[12] JACKSON B, KEEFE D F. Lift-off:using reference imagery and freehand sketching to create 3D models in VR[J]. IEEE Transactions on Visualization and Computer Graphics, 2016, 22(4):1442-1451.
[13] ZHU X, SONG L, YOU L, et al. Brush2Model:convolution surface-based brushes for 3D modelling in HMD-based virtual environments[J/OL]. Computer Animation and Virtual Worlds, 2017, e1764. https://doi.org/10.1002/cav.1764.
[14] Google's Tilt Brush.[EB/OL].[2017-03-19]. www.tiltbrush.com.
[15] 何雪军, 王进, 陆国栋, 等. 基于三角网切片及碰撞检测的工业机器人三维头像雕刻[J]. 浙江大学学报:工学版, 2017, 51(6):1104-1110. HE Xue-jun, WANG Jin, LU Guo-dong, et al. 3D head portrait sculpture by industrial robot based on triangular mesh slicing and collision detection[J]. Journal of Zhejiang University:Engineering Science, 2017, 51(6):1104-1110.
[16] PIXOLOGIC:Zbrush[EB/OL].[2017-05-04]. http://pixologic.com/.
[17] AUTODESK:Mudbox 2017[EB/OL].[2017-06-15]. http://www.autodesk.com/products/mudbox/overview.
[18] JI Z, LIU L, WANG Y. B-Mesh:a modeling system for base meshes of 3D articulated shapes[J]. Computer Graphics Forum, 2010, 29(7):2169-2177.

[1] HAN Yong, NING Lian-ju, ZHENG Xiao-lin, LIN Wei-hua, SUN Zhong-yuan. Matrix factorization recommendation based on social information and item exposure[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2019, 53(1): 89-98.
[2] ZHENG Zhou, ZHANG Xue-chang, ZHENG Si-ming, SHI Yue-ding. Liver segmentation in CT images based on region-growing and unified level set method[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(12): 2382-2396.
[3] ZHAO Li-ke, ZHENG Shun-yi, WANG Xiao-nan, HUANG Xia. Rigid object position and orientation measurement based on monocular sequence[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(12): 2372-2381.
[4] HE Jie-guang, PENG Zhi-ping, CUI De-long, LI Qi-rui. Teaching-learning-based optimization algorithm with local dimension improvement[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(11): 2159-2170.
[5] LI Zhi, SHAN Hong, MA Tao, HUANG Jun. Group discovery of mobile terminal users based on reverse-label propagation algorithm[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(11): 2171-2179.
[6] WANG Shuo-peng, YANG Peng, SUN Hao. Construction process optimization of fingerprint database for auditory localization[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(10): 1973-1979.
[7] WEI Xiao-feng, CHENG Cheng-qi, CHEN Bo, WANG Hai-yan. Chain code based on independent edge number[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1686-1693.
[8] CHEN Rong-hua, WANG Ying-han, BU Jia-jun, YU Zhi, GAO Fei. Website accessibility sampling evaluation based on KNN and local regression[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1702-1708.
[9] ZHANG Cheng-zhi, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Piecewise noise variance estimation of images based on wavelet transform[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1804-1810.
[10] LIU Zhou-zhou, LI Shi-ning, LI Bin, WANG Hao, ZHANG Qian-yun, ZHENG Ran. New elastic collision optimization algorithm and its application in sensor cloud resource scheduling[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1431-1443.
[11] WANG Yong-chao, ZHU Kai-lin, WU Qi-xuan, LU Dong-ming. Adaptive display technology of high precision model based on local rendering[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1461-1466.
[12] SUN Nian, LI Yu-qiang, LIU Ai-hua, LIU Chun, LI Wei-wei. Microblog sentiment analysis based on collaborative learning under loose conditions[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1452-1460.
[13] ZHENG Shou-guo, CUI Yan-min, WANG Qing, YANG Fei, CHENG Liang. Design of field data acquisition platform for aircraft assembly[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1526-1534.
[14] BI Xiao-jun, WANG Chao. Many-objective evolutionary algorithm based on hyperplane projection[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(7): 1284-1293.
[15] ZHANG Ting-rong, TENG Qi-zhi, LI Zheng-ji, QING Lin-bo, HE Xiao-hai. Super-resolution reconstruction for three-dimensional core CT image[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(7): 1294-1301.