Please wait a minute...
Frontiers of Optoelectronics

ISSN 2095-2759

ISSN 2095-2767(Online)

CN 10-1029/TN

Postal Subscription Code 80-976

Front. Optoelectron.    2015, Vol. 8 Issue (3) : 319-328    https://doi.org/10.1007/s12200-015-0453-7
RESEARCH ARTICLE
Lens distortion correction based on one chessboard pattern image
Yubin WU,Shixiong JIANG,Zhenkun XU,Song ZHU,Danhua CAO()
School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China
 Download: PDF(1709 KB)   HTML
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

This paper proposes a detection method of chessboard corner to correct camera distortions –including radial distortion, decentering distortion and prism distortion. This proposed method could achieve high corner detection rate. Then we used iterative procedure to optimize distortion parameter to minimize distortion residual. In this method, first, non-distortion points are evaluated by four points near image center; secondly, Levenberg-Marquardt nonlinear optimization algorithm was adopted to calculate distortion parameters, and then to correct image by these parameters; thirdly, we calculated corner points on the corrected image, and repeated previous two steps until distortion parameters converge. Results showed the proposed method by iterative procedure can make the impact of slight distortion around image center negligible and the average of distortion residual of one line is almost 0.3 pixels.

Keywords computer vision      camera distortion      distortion correction      corner detection     
Corresponding Author(s): Danhua CAO   
Just Accepted Date: 04 June 2015   Online First Date: 30 June 2015    Issue Date: 18 September 2015
 Cite this article:   
Yubin WU,Shixiong JIANG,Zhenkun XU, et al. Lens distortion correction based on one chessboard pattern image[J]. Front. Optoelectron., 2015, 8(3): 319-328.
 URL:  
https://academic.hep.com.cn/foe/EN/10.1007/s12200-015-0453-7
https://academic.hep.com.cn/foe/EN/Y2015/V8/I3/319
Fig.1  (a) Barrel distortion image; (b) pincushion distortion image
Fig.2  Image with decentering distortion
Fig.3  Image with thin prism distortion
Fig.4  (a) Distortion image; (b) the dots are detected corners in image (a) and the circles are ideal points location.
Fig.5  Forward-mapping from distortion image to correction image
Fig.6  White rectangles are the detected corners: (a) the proposed method; (b) the OpenCV method
Fig.7  Origin image without distortion
Fig.8  (a) and (b) are images with different distortion parameters; (c) and (d) are corrected image by proposed method, which parameters are shown in Table 1
origin distortion image Figure 8(a) Figure 8 (b)
distortion model k 1 = 3.0 e - 6 , k 2 = - 5.8 e - 13 p 1 = - 2.4 e - 5 , p 2 = 2.86 e - 5 s 1 = 6.5 e - 6 , s 2 = - 7.2 e - 6 k 1 = - 2.3 e - 6 , k 2 = 4.3 e - 13 p 1 = 5.0 e - 5 , p 2 = - 3.4 e - 5 s 1 = 7.8 e - 6 , s 2 = 5.6 e - 6
correct image by proposed method Figure 8(c) Figure 8(d)
correct model by proposed method k 1 = 3.67 e - 6 , k 2 = - 3.47 e - 12 p 1 = - 1.99 e - 5 , p 2 = 2.36 e - 5 s 1 = - 1.26 e - 6 , s 2 = 2.87 e - 7 k 1 = - 2.67 e - 6 , k 2 = 1.37 e - 13 p 1 = 4.90 e - 5 , p 2 = - 2.79 e - 5 s 1 = 1.48 e - 5 , s 2 = - 6.87 e - 6
Tab.1  Compares the distortion between man-made parameters and the results of proposed method
Fig.9  Performance of the proposed method with the synthetic data, dots are distorted points and circles are non-distorted points. (a) The distorted image; (b) the corrected image by the proposed method
Fig.10  Compare ERROR of the proposed method with Gao’s and Brown’s method versus different noises levels
Fig.11  ERROR of different rotations around the z-axis of image versus noises levels
Fig.12  ERROR versus different rotation around the x-axis of image
Fig.13  (a) Pictures taken with 4 mm lens, image size is 752 ×480; (b) pictures is taken with 8 mm lens, image size is 640 ×480
Fig.14  (a) Corrected image taken with 4 mm lens; (b) corrected image taken with 8 mm lens
len 1 focal f = 4 mm len 2 focal f = 8 mm
correct model k 1 = 8.86 e - 7 , k 2 = 3.97 e - 12 p 1 = 1.23 e - 5 , p 2 = 5.64 e - 5 s 1 = 1.43 e - 5 , s 2 = - 2.23 e - 5 k 1 = 7.72 e - 7 , k 2 = 1.98 e - 14 p 1 = 1.05 e - 8 , p 2 = 2.89 e - 8 s 1 = 1.37 e - 8 , s 2 = 2.15 e - 8
RMSE 0.34 pixel 0.25 pixel
maximum distortion rate 0.13% 0.10%
Tab.2  Experiment results with proposed method
1 Abellard A, Bouchouicha M, Ben Khelifa M. A genetic algorithm application to stereo calibration. In: Proceedings of 2005 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Espoo, Finland. 2005, 285–290
2 Brown D C. Close-range camera calibration. Photogrammetric Engineering, 1971, 37(8): 855–866
3 Weng J, Cohen P, Herniou M. Camera calibration with distortion models and accuracy evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(10): 965–980
https://doi.org/10.1109/34.159901
4 Zhang Z. On the epipolar geometry between two images with lens distortion. In: Proceedings of the 13th International Conference on Pattern Recognition (ICPR), Vienna. 1996, 407–411
5 Du X, Li H, Zhu Y. Camera lens radial distortion correction using two-view projective invariants. Optics Letters, 2011, 36(24): 4734–4736
https://doi.org/10.1364/OL.36.004734 pmid: 22179866
6 Goljan M, Fridrich J. Estimation of lens distortion correction from single images. In: Proceedings of SPIE 9028, Media Watermarking, Security, and Forensics. 2014, 90280N
7 Prescott B, McLean G. Line-based correction of radial lens distortion. Graphical Models and Image Processing, 1997, 59(1): 39–47
https://doi.org/10.1006/gmip.1996.0407
8 Gao D, Yin F. Computing a complete camera lens distortion model by planar homography. Optics & Laser Technology, 2013, 49: 95–107
https://doi.org/10.1016/j.optlastec.2012.12.004
9 Hartley R, Kang S B. Parameter-free radial distortion correction with center of distortion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(8): 1309–1321
https://doi.org/10.1109/TPAMI.2007.1147 pmid: 17568137
10 Park J, Byun S C, Lee B U. Lens distortion correction using ideal image coordinates. IEEE Transactions on Consumer Electronics, 2009, 55(3): 987–991
https://doi.org/10.1109/TCE.2009.5278053
11 Manolis L. Levenberg-Marquardt nonlinear least squares algorithms in C/C++
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed