面向元宇宙的移动端视频交互系统设计与实现
近年来,备受瞩目的元宇宙概念在逐步付诸实现的过程中,涉及一系列广泛的技术领域,并且从用户角度对这些技术普遍持有严苛标准。为了提高技术准备的效率,需要准确把握元宇宙产品的关键要素。本文通过对中西语境下元宇宙概念的梳理分析,提出以拟真和虚实交融作为元宇宙产品的本质特征。此外,作为一个初步的实证案例,针对智能手机这一普及率高的终端设备,本研究利用并改进现有的高效视频抠像技术和色彩迁移算法,设计并实现了一种面向元宇宙特征的视频交互系统。
[1] 王儒西,向安玲,沈阳,2020—2021年元宇宙发展研究报告,清华大学新媒体研究中心.
[2]Porter, T., Duff, T., “Compositing digital images”, Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’84, Association for Computing Machinery, New York, NY, USA, pp. 253–259 (1984).
[3]Smith, A. R., Blinn, J. F., “Blue screen matting”, Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96, Association for Computing Machinery, New York, NY, USA, pp. 259–268 (1996).
[4]Shen, X., Tao, X., Gao, H., Zhou, C., Jia, J., “Deep Automatic Portrait Matting”, Computer Vision – ECCV 2016, B. Leibe, J. Matas, N. Sebe, and M. Welling, Eds.,Lecture Notes in Computer Science, Springer International Publishing, Cham, pp. 92–107 (2016).
[5]Zhu, B., Chen, Y., Wang, J., Liu, S., Zhang, B., Tang, M., “Fast Deep Matting for Portrait Animation on Mobile Phone”, Proceedings of the 25th ACM International Conference on Multimedia, MM ’17, Association for Computing Machinery, New York, NY, USA, pp. 297–305 (2017).
[6]Pandey, R., Escolano, S. O., Legendre, C., Häne, C., Bouaziz, S., Rhemann, C., Debevec, P., Fanello, S., “Total relighting: learning to relight portraits for background replacement”, ACM Trans. Graph., 40(4), p. 43:1-43:21 (2021).
[7]Lin, S., Yang, L., Saleemi, I., Sengupta, S., Robust High-Resolution Video Matting with Temporal Guidance, arXiv (2021).
[8]Ke, Z., Sun, J., Li, K., Yan, Q., Lau, R. W. H., MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decomposition, arXiv (2022).
[9]Phong, B. T., “Illumination for computer generated pictures”, Commun. ACM, 18(6), pp. 311–317 (1975).
[10]Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P., “Color transfer between images”, IEEE Computer Graphics and Applications, 21(5), pp. 34–41 (2001).