1. Internet and Multimedia Engineering, Konkuk University, Seoul 143-701, Korea 2. Department of Advanced Technology Fusion, Konkuk University, Seoul 143-701, Korea
The objective of this research is the rapid reconstruction of ancient buildings of historical importance using a single image. The key idea of our approach is to reduce the infinite solutions that might otherwise arise when recovering a 3D geometry from 2D photographs. The main outcome of our research shows that the proposed methodology can be used to reconstruct ancient monuments for use as proxies for digital effects in applications such as tourism, games, and entertainment, which do not require very accurate modeling. In this article, we consider the reconstruction of ancient Mughal architecture including the Taj Mahal. We propose a modeling pipeline that makes an easy reconstruction possible using a single photograph taken from a single view, without the need to create complex point clouds from multiple images or the use of laser scanners. First, an initial model is automatically reconstructed using locally fitted planar primitives along with their boundary polygons and the adjacency relation among parts of the polygons. This approach is faster and more accurate than creating a model from scratch because the initial reconstruction phase provides a set of structural information together with the adjacency relation, which makes it possible to estimate the approximate depth of the entire structural monument. Next, we use manual extrapolation and editing techniques with modeling software to assemble and adjust different 3D components of the model. Thus, this research opens up the opportunity for the present generation to experience remote sites of architectural and cultural importance through virtual worlds and real-time mobile applications. Variations of a recreated 3D monument to represent an amalgam of various cultures are targeted for future work.
. [J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(1): 12-27.
Divya Udayan J, HyungSeok KIM, Jee-In KIM. Animage-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components. Front. Inform. Technol. Electron. Eng, 2015, 16(1): 12-27.
S. AlHalawani,, Y.L. Yang,, H. Liu,, et al., 2013. Interactive facades analysis and synthesis of semi-regular facades. Comput. Graph. Forum, 32(2pt2): 215−224. https://doi.org/10.1111/cgf.12041
2
F. Bao,, D.M. Yan,, N.J. Mitra,, et al., 2013. Generating and exploring good building layouts. ACM Trans. Graph., 32(4): 122.1−122.10. https://doi.org/10.1145/2461912.2461977
3
H. Bay,, T. Tuytelaars,, L. van Gool,, 2006. SURF: speeded up robust features. Proc. 9th European Conf. on Computer Vision, p.404−417. https://doi.org/10.1007/11744023_32
D. Ceylan,, N.J. Mitra,, H. Li,, et al., 2012. Factored facade acquisition using symmetric line arrangements. Comput. Graph. Forum, 31(2pt3): 671−680. https://doi.org/10.1111/j.1467-8659.2012.03046.x
6
D. Ceylan,, N.J. Mitra,, Y. Zheng,, et al., 2014. Coupled structure-from-motion and 3D symmetry detection for urban facades. ACM Trans. Graph., 33(1): 2.1−2.15. https://doi.org/10.1145/2517348
7
E. Chen,, L. Williams,, 1993. View interpolation for image synthesis. Proc. 20th Annual Conf. on Computer Graphics and Interative Techniques, p.279−288. https://doi.org/10.1145/166117.166153
8
T. Chen,, Z. Zhu,, A. Shamir,, et al., 2013. 3-Sweep: extruding editable objects from a single photo. ACM Trans. Graph., 32(6): 195.1−195.10. https://doi.org/10.1145/2508363.2508378
9
A. Çıçek,, M. Gülesın,, 2004. Reconstruction of 3D models from 2D orthographic views using solid extrusion and revolution. J. Mater. Process. Technol., 152(3): 291−298. https://doi.org/10.1016/j.jmatprotec.2004.04.368
10
P. Cignoni,, C. Rocchini,, R. Scopigno,, 1998. Metro: measuring error on simplified surfaces. Comput. Graph. Forum, 17(2):167−174. https://doi.org/10.1111/1467-8659.00236
E.R. Davies,, 2005. Machine Vision: Theory, Algorithms, Practicalities. Morgan Kauffman Press, San Francisco, USA.
13
P.E. Debevec,, C.J. Taylor,, J. Malik,, 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. Proc. 23rd Annual Conf. on Computer Graphics and Interative Techniques, p.11−20. https://doi.org/10.1145/237170.237191
14
L.R. Dung,, C.M. Huang,, Y.Y. Wu,, 2013. Implementation of RANSAC algorithm for feature-based image registration. J. Comput. Commun., 1: 46−50. https://doi.org/10.4236/jcc.2013.16009
15
Encyclopedia, 2014. Mughal Architecture, Britannica Online. Available from [Accessed on 2014-Dec].
16
O. Faugeras,, S. Laveau,, L. Robert,, 1995. 3-D reconstruction of urban scenes from sequences of images. Automatic Extraction of Man-Made Objects from Aerial and Space Images, p.145−168. https://doi.org/10.1007/978-3-0348-9242-1_15
J.M. Frahm,, P. Fite-Georgel,, D. Gallup,, et al., 2010. Building Rome on a cloudless day. Proc. 11th European Conf. on Computer Vision, p. 368−381. https://doi.org/10.1007/978-3-642-15561-1_27
19
J. Garcia-Gago,, J. Gomez-Lahoz,, J. Rodriguez-Mendez,, et al., 2014. Historical single image-based modeling: the case of Gobierna Tower, Zamora (Spain). Remote Sens., 6(2): 1085−1101. https://doi.org/10.3390/rs6021085
20
S. Geman,, D. Geman,, 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Patt. Anal. Mach. Intell., 6(6): 721−741. https://doi.org/10.1109/TPAMI.1984.4767596
21
T.H. Gormen,, C.E. Leiserson,, R.L. Rivest,, et al., 1990. Introduction to Algorithms. MIT Press, McGraw-Hill Book Company, New York, USA.
22
E. Guillou,, D. Meneveaux,, E. Maisel,, et al., 2000. Using vanishing points for camera calibration and coarse 3D reconstruction from a single image. Vis. Comput., 16(7): 396−410. https://doi.org/10.1007/PL00013394
23
D. Hoiem,, A.A. Efros,, M. Hebert,, 2005. Geometric context from a single image. Proc. 10th IEEE Int. Conf. on Computer Vision, p. 654−661. https://doi.org/10.1109/ICCV.2005.107
Y. Horry,, K. Anjyo,, K. Arai,, 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. Proc. 24th Annual Conf. on Computer Graphics and Interactive Techniques, p.225−232. https://doi.org/10.1145/258734.258854
26
S. Kang,, 1998. Depth Painting for Image-Based Rendering Applications. Technical Report, Compaq Computer Corporation, Cambridge Research Lab.
27
S. Laveau,, O. Faugeras,, 1994. 3D scene representation as a collection of images. Proc. 12th Int. Conf. on Pattern Recognition, p.689−691. https://doi.org/10.1109/ICPR.1994.576404
28
D. Liebowitz,, A. Criminisi,, A. Zisserman,, 1999. Creating architectural models from images. Comput. Graph. Forum, 18(3): 39−50. https://doi.org/10.1111/1467-8659.00326
J. Ma,, J.C. Chan,, F. Canters,, 2010. Fully automatic subpixel image registration of multiangle CHRIS/Proba data. IEEE Trans. GeoSci. Remote Sens., 48(7): 2829−2839. https://doi.org/10.1109/TGRS.2010.2042813
31
A.M. Manferdini,, 2012. A methodology for the promotion of cultural heritage sites through the use of low-cost technologies and procedures. Proc. 17th Int. Conf. on 3D Web Technology, p.180. https://doi.org/10.1145/2338714.2338747
32
L. McMillan,, G. Bishop,, 1995. Plenoptic modeling: an image-based rendering system. Proc. 22nd Annual Conf. on Computer Graphics and Interactive Techniques, p.39−46.] https://doi.org/10.1145/218380.218398
33
N.J. Mitra,, M. Pauly,, 2008. Symmetry for architectural design. Advances in Architectural Geometry, p.13−16.
34
N.J. Mitra,, M. Pauly,, M. Wand,, et al., 2013. Symmetry in 3D geometry: extraction and applications. Comput. Graph. Forum, 32(6): 1−23. https://doi.org/10.1111/cgf.12010
35
P. Muller,, G. Zeng,, P. Wonka,, et al., 2007. Image-based procedural modeling of facades. ACM Trans. Graph., 26(3): 85.1−85.9. https://doi.org/10.1145/1276377.1276484
36
T. Nagai,, M. Ikehara,, A. Kurematsu,, 2007. HMM-based surface reconstruction from single images. Syst. Comput. Jpn., 38(11): 80−89. https://doi.org/10.1002/scj.10685
37
L. Nan,, A. Sharf,, H. Zhang,, et al., 2010. SmartBoxes for interactive urban reconstruction. ACM Trans. Graph., 29(4): 93.1−93.10. https://doi.org/10.1145/1778765.1778830
B.M. Oh,, M. Chen,, J. Dorsey,, et al., 2001. Image-based modeling and photo editing. Proc. 28th Annual Conf. on Computer Graphics and Interactive Techniques, p.433−442. https://doi.org/10.1145/383259.383310
40
P. Poulin,, M. Ouimet,, M.C. Frasson,, 1998. Interactively modeling with photogrammetry. Proc. Eurographics Workshop on Rendering, p.93−104. https://doi.org/10.1007/978-3-7091-6453-2_9
41
T. Pylvanainen,, J. Berclaz,, T. Korah,, et al., 2012. 3D city modeling from street-level data for augmented reality applications. Proc. 2nd Int. Conf. on 3D Imaging, Modeling, Processing, Visualization and Transmission, p.238−245. https://doi.org/10.1109/3DIMPVT.2012.19
42
F. Remondino,, 2011. Heritage recording and 3D modeling with photogrammetry and 3D scanning. Remote Sens., 3(6): 1104−1138. https://doi.org/10.3390/rs3061104
43
A. Saxena,, S.H. Chung,, A.Y. Ng,, 2008a. 3-D depth reconstruction from a single still image. Int. J. Comput. Vis., 76(1): 53−69. https://doi.org/10.1007/s11263-007-0071-y
44
A. Saxena,, M. Sun,, A.Y. Ng,, 2008b. Make3D: depth perception from a single still image. Proc. 23rd AAAI Conf. on Artificial Intelligence, p.1571−1576.
45
J. Shade,, S. Gortler,, L. He,, et al., 1998. Layered depth images. Proc. 25th AAAI Annual Conf. on Computer Graphics and Interactive Techniques, p.231−242. https://doi.org/10.1145/280814.280882
46
C.H. Shen,, H. Fu,, K. Chen,, et al., 2012. Structure recovery by part assembly. ACM Trans. Graph., 31(6): 180.1−180.11. https://doi.org/10.1145/2366145.2366199
47
A.D. Styliadis,, L.A. Sechidis,, 2011. Photography-based facade recovery & 3D modeling: a CAD application in cultural heritage. J. Cult. Herit., 12(3): 243−252. https://doi.org/10.1016/j.culher.2010.12.008
48
B.J. Super,, A.C. Bovik,, 1995. Shape from texture using local spectral moments. IEEE Trans. Patt. Anal. Mach. Intell., 17(4): 333−343. https://doi.org/10.1109/34.385983
49
Y. Wang,, M. Olano,, 2011. A framework for GPU 3D model reconstruction using structure-from-motion. Proc. 38th Annual Conf. on Computer Graphics and Interactive Techniques, p.27.1. https://doi.org/10.1145/2037715.2037748
50
Y.M. Wei,, L. Kang,, B. Yang,, et al., 2013. Applications of structure from motion: a survey. J. Zhejiang Univ.-Sci. C (Comput. & Electron.), 14(7): 486−494. https://doi.org/10.1631/jzus.CIDE1302
51
M.D. Yang,, C.F. Chao,, K.S. Huang,, et al., 2013. Imagebased 3D scene reconstruction and exploration in augmented reality. Autom. Constr., 33: 48−60. https://doi.org/10.1016/j.autcon.2012.09.017
52
H. Zhang,, K. Xu,, W. Jiang,, et al., 2013. Layered analysis of irregular facades via symmetry maximization. ACM. Trans. Graph., 32(4): 121.1−121.10. https://doi.org/10.1145/2461912.2461923
53
L. Zhang,, G. Dugas-Phocion,, J.S. Samson,, et al., 2002. Single-view modeling of free-form scenes. J. Visual. Comput. Animat., 13(4): 225−235.] https://doi.org/10.1002/vis.291
