Please wait a minute...
Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184

Frontiers of Information Technology & Electronic Engineering  2017, Vol. 18 Issue (12): 1978-1990   https://doi.org/10.1631/FITEE.1700253
  本期目录
形状空间下基于级联回归的三维人脸重建
刘峰, 曾丹, 李婧, 赵启军()
四川大学计算机学院,中国成都市,610065
On 3Dface reconstruction via cascaded regression in shape space
Feng LIU, Dan ZENG, Jing LI, Qi-jun ZHAO()
College of Computer Science, Sichuan University, Chengdu 610065, China
 全文: PDF(1964 KB)  
摘要:

最近,级联回归方法在基于二维图像的三维人脸重建中取得了良好的效果。本文主要探究了基于级联回归三维人脸重建中四个未解决的重要问题:(1)二维特征点数量的影响;(2)三维点云数量的影响;(3)自动二维特征点的检测方法;(4)算法的收敛。本文专门设计了一个简单有效的基于形状空间的级联回归三维重建算法。该算法有效利用各类独立的自动二维特征点检测算法,且重建的三维人脸具有和输入图像相同的姿态和表情。同时在训练中,本文设计了一种随机扰动检二维特征点位置信息的策略,使得算法更有效且更鲁棒。最后,通过大量的对比实验证明了该算法不仅有着良好的精度和计算效率,而且对加深级联回归三维重建方法的理解有着启发意义。

Abstract

Cascaded regression has been recently applied to reconstruct 3D faces from single 2D images directly in shape space, and has achieved state-of-the-art performance. We investigate thoroughly such cascaded regression based 3D face reconstruction approaches from four perspectives that are not well been studied: (1) the impact of the number of 2D landmarks; (2) the impact of the number of 3D vertices; (3) the way of using standalone automated landmark detection methods; (4) the convergence property. To answer these questions, a simplified cascaded regression based 3D face reconstruction method is devised. This can be integrated with standalone automated landmark detection methods and reconstruct 3D face shapes that have the same pose and expression as the input face images, rather than normalized pose and expression. An effective training method is also proposed by disturbing the automatically detected landmarks. Comprehensive evaluation experiments have been carried out to compare to other 3D face reconstruction methods. The results not only deepen the understanding of cascaded regression based 3D face reconstruction approaches, but also prove the effectiveness of the proposed method.

Key words3D face reconstruction    Cascaded regressor    Shape space    Real-time
收稿日期: 2017-04-16      出版日期: 2018-03-08
通讯作者: 赵启军     E-mail: qjzhao@scu.edu.cn
Corresponding Author(s): Qi-jun ZHAO   
 引用本文:   
刘峰, 曾丹, 李婧, 赵启军. 形状空间下基于级联回归的三维人脸重建[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(12): 1978-1990.
Feng LIU, Dan ZENG, Jing LI, Qi-jun ZHAO. On 3Dface reconstruction via cascaded regression in shape space. Front. Inform. Technol. Electron. Eng, 2017, 18(12): 1978-1990.
 链接本文:  
https://academic.hep.com.cn/fitee/CN/10.1631/FITEE.1700253
https://academic.hep.com.cn/fitee/CN/Y2017/V18/I12/1978
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed