增强虚拟环境中基于虚拟影像的视频注册方法A Methodology of Video Registration in Augmented Virtural Environment with Captured Image
佟家兴;靳明;张盛源;付仲良;
摘要(Abstract):
视频三维叠加显示技术的增强虚拟环境技术(augmented virtual environment,AVE)近年来广受关注,相机标定技术的视频注册方法成为实现增强虚拟环境的研究热点。针对虚拟三维环境的特点所提出的方法中,首先借助虚拟相机生成包含深度信息的虚拟影像来进行控制点对提取配准;进而通过直接线性变换和非线性优化方法从关于控制点对建立的方程中求解相机矩阵;随后通过相机矩阵建立标定参数与三维渲染引擎之间的联系,并用阴影贴图技术进行视频映射;最后使用该方法在武汉大学校园内和某厂区内进行了视频注册实验,实验结果证明了所提出的方法的有效性和适用性。
关键词(KeyWords): 增强虚拟环境;虚拟影像;相机标定;纹理映射;视频注册
基金项目(Foundation): 河南省交通运输厅科技计划项目(2019G1)
作者(Authors): 佟家兴;靳明;张盛源;付仲良;
DOI: 10.14188/j.2095-6045.2020045
参考文献(References):
- [1] Neumann U,You S,Hu J,et al. Augmented Virtual Environments(AVE):Dynamic Fusion of Imagery and 3D Models[C]. Virtual Reality,VR2003,Los Angeles,USA,2003
- [2]简洪登,范湘涛.基于GLSL的多重视频纹理映射与融合[J].计算机工程与设计,2014,35(11):3 873-3 878
- [3]叶松,陈喆,阚红涛.海量视频流与三维场景实时集成技术[J].长江科学院院报,2019,36(11):162-166
- [4]吴勇,王美珍.视频空间化方法及其应用研究[J].南京师大学报(自然科学版),2014,37(2):119-25
- [5] Hu Y,Wu W,Zhou Z. Video Driven Pedestrian Visualization with Characteristic Appearances[J]. Virtual Reality Software and Technology,2015:183-186
- [6] Pan C W,Chen Y S,Wang G P. Virtual-Real Fusion with Dynamic Scene from Videos[C]. 2016 International Conference on Cyberworlds,Chongqing,China,2016
- [7]潘成伟,张建国,陈毅松,等.利用一致性检验的多图像中前景物体的自动分割[J].计算机辅助设计与图形学学报,2017,29(6):1 028-1 036
- [8]邱茂林,马颂德,李毅.计算机视觉中摄像机定标综述[J].自动化学报,2000,26(1):43-59
- [9] Abdel-Aziz Y I,Karara H M. Direct Linear Transformation into Object Space Coordinates in Close-Range Photogrammetry[J]. Close-Range Photogrammetry,1971:1-18
- [10] Tsai R Y. A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses[J]. IEEE Journal of Robotics and Automation,1987,3(4):323-344
- [11] Zhang Y Z. A Flexible New Technique for Camera Calibration[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(11):1 330-1 334
- [12] Pollefeys M,Van Gool L,Oosterlinck A. The Modulus Constraint:A New Constraint Self-Calibration[C]. 13th International Conference on Pattern Recognition,Vienna,Austria,1996
- [13] Guillou E,Meneveaux D,Maisel E,et al. Using Vanishing Points for Camera Calibration and Coarse 3D Reconstruction from a Single Image[J]. Visual Computer,2000,16(7):396-410
- [14] Sawhney H S,Arpa A,Kumar R,et al. Video Flashlights—Real Time Rendering of Multiple Videos for Immersive Model Visualization[C]. 13th Eurographics Workshop on Rendering,Pisa,Italy,2002
- [15] Milosavljevi?A,Ran?i?D,Dimitrijevi?A,et al. A Method for Estimating Surveillance Video Georeferences[J]. International Journal of Geo-Information,2017,6(7):211
- [16]张祖勋.数字摄影测量与计算机视觉[J].武汉大学学报·信息科学版,2004,29(12):1 035-1 039