Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Front. Comput. Sci.    2016, Vol. 10 Issue (6) : 985-999    https://doi.org/10.1007/s11704-016-5422-9
REVIEW ARTICLE
A survey of sketch based modeling systems
Chao DING,Ligang LIU()
School of Mathematical Sciences, University of Science and Technology of China, Hefei 230026, China
 Download: PDF(604 KB)  
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

As 3D technology, including computer graphics, virtual reality and 3D printing, has been rapidly developed in the past years, 3D models are gaining an increasingly huge demand. Traditional 3D modeling platforms such as Maya and ZBrush, utilize “windows, icons, menus, pointers” (WIMP) interface paradigms for fine-grained control to construct detailed models. However, the modeling progress can be tedious and frustrating and thus too hard for a novice user or even a well trained artist. Therefore, a more intuitive interface is needed. Sketch, an intuitive communication and modeling tool for human beings, becomes the first choice of modeling community. So far, various sketch-based modeling systems have been created and studied. In this paper, we attempt to show how these systems work and give a comprehensive survey. We review and categorize the systems in four aspects: the input, the knowledge they use, the modeling approach and the output. We also discuss about inherent challenges and open problems for researchers in the future.

Keywords sketch-based modeling      interactive design      sketch comprehension     
Corresponding Author(s): Ligang LIU   
Just Accepted Date: 17 June 2016   Online First Date: 25 July 2016    Issue Date: 11 October 2016
 Cite this article:   
Chao DING,Ligang LIU. A survey of sketch based modeling systems[J]. Front. Comput. Sci., 2016, 10(6): 985-999.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-016-5422-9
https://academic.hep.com.cn/fcs/EN/Y2016/V10/I6/985
1 Botsch M, Pauly M, Kobbelt L, Alliez P, Lévy B, Bischoff S, Röossl C. Geometric modeling based on polygonal meshes. In: Proceedings of the ACM SIGGRAPH Course Notes. 2007
https://doi.org/10.1145/1281500.1281640
2 Perry R N, Frisken S F. Kizamu: a system for sculpting digital characters. In: Proceedings of the 28th ACM Annual Conference on Computer Graphics and Interactive Techniques. 2001, 47–56
https://doi.org/10.1145/383259.383264
3 Zoran A, Shilkrot R, Nanyakkara S, Paradiso J. The hybrid artisans: a case study in smart tools. ACM Transactions on Computer-Human Interaction, 2014, 21(3): 15
https://doi.org/10.1145/2617570
4 Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 2013, 56(1): 116–124
https://doi.org/10.1145/2398356.2398381
5 Henry P, Krainin M, Herbst E, Ren X F, Fox D. RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research, 2012, 31(5): 647–663
https://doi.org/10.1177/0278364911434148
6 Smisek J, Jancosek M, Pajdla T. 3D with kinect. In: Fossati A, Gall J, Helmut Grabner H, . <Eds/>. Consumer Depth Cameras for Computer Vision: Research Topics and Applications. London: Springer-Verlag, 2013, 3–25
https://doi.org/10.1007/978-1-4471-4640-7_1
7 Quan L. Image-based modeling. Springer Science & Business Media, 2010
https://doi.org/10.1007/978-1-4419-6679-7
8 Fan L B, Wang R M, Xu L L, Deng J S, Liu L G. Modeling by drawing with shadow guidance. Computer Graphics Forum, 2013, 23(7): 157–166
https://doi.org/10.1111/cgf.12223
9 Yuan X R, Xu H, Nguyen M, Shesh A, Chen B Q. Sketch-based segmentation of scanned outdoor environment models. In: Proceedings of EG Workshop on Sketch-Based Interfaces and Modeling. 2005, 19–26
10 Wu H Y, Pan C H, Pan J, Yang Q, Ma S D. A sketch-based interactive framework for real-time mesh segmentation. In: Proceedings of Computer Graphics International. 2007
11 Schmidt R, Wyvill B, Sousa M C, Jorge J A. Shapeshop: sketch-based solid modeling with blobtrees. In: Proceedings of ACM SIGGRAPH 2007 courses. 2007
https://doi.org/10.1145/1281500.1281554
12 Turquin E, Wither J, Boissieux L, Cani M P, Hughes J F. A sketchbased interface for clothing virtual characters. IEEE Computer Graphics and Applications, 2007, 27(1): 72–81
https://doi.org/10.1109/MCG.2007.1
13 Igarashi T, Matsuoka S, Tanaka H. Teddy: a sketching interface for 3D freeform design. In: Proceedings of the 26th ACM Annual Conference on Computer Graphics and Interactive Techniques. 1999, 409–416
https://doi.org/10.1145/311535.311602
14 Olsen L, Samavati F F, Sousa M C, Jorge J A. Sketch-based modeling: a survey. Computers & Graphics, 2009, 33(1): 85–103
https://doi.org/10.1016/j.cag.2008.09.013
15 Cook M T, Agah A. A survey of sketch-based 3-D modeling techniques. Interacting with Computers, 2009, 21(3): 201–211
https://doi.org/10.1016/j.intcom.2009.05.004
16 Kho Y, Garland M. Sketching mesh deformations. In: Proceedings of ACM SIGGRAPH 2007 Courses. 2007
https://doi.org/10.1145/1281500.1281552
17 Karpenko O A, Hughes J F. Smoothsketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics, 2006, 25(3): 589–598
https://doi.org/10.1145/1141911.1141928
18 Xu K, Chen K, Fu H B, Sun W K L, Hu S M. Sketch2Scene: sketchbased co-retrieval and co-placement of 3D models. ACM Transactions on Graphics, 2013, 32(4): 123
https://doi.org/10.1145/2461912.2461968
19 Iarussi E, Bommes D, Bousseau A. Bendfields: regularized curvature fields from rough concept sketches. ACM Transactions on Graphics, 2015, 34(3): 24
https://doi.org/10.1145/2710026
20 Bae S H, Balakrishnan R, Singh K. ILoveSketch: as-natural-aspossible sketching system for creating 3D curve models. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology. 2008, 151–160
https://doi.org/10.1145/1449715.1449740
21 Lee S, Feng D, Grimm C, Gooch B. A sketch-based user interface for reconstructing architectural drawings. Computer Graphics Forum, 2008, 27(1): 81–90
https://doi.org/10.1111/j.1467-8659.2007.01098.x
22 Bae S H, Balakrishnan R, Singh K. EverybodyLovesSketch: 3D sketching for a broader audience. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. 2009, 59–68
https://doi.org/10.1145/1622176.1622189
23 Zimmermann J, Nealen A, Alexa M. SilSketch: automated sketchbased editing of surface meshes. In: Proceedings of the 4th Eurographics Workshop on Sketch-based Interfaces and Modeling. 2007, 23–30
https://doi.org/10.1145/1384429.1384438
24 Zimmermann J, Nealen A, Alexa M. Sketchbased interfaces: sketching contours. Computers Graphics, 2008, 32(5): 486–499
https://doi.org/10.1016/j.cag.2008.05.006
25 Kraevoy V, Sheffer A, van de Panne M. Modeling from contour drawings. In: Proceedings of the 6th ACM Eurographics Symposium on Sketch-Based Interfaces and Modeling. 2009, 37–44
https://doi.org/10.1145/1572741.1572749
26 Nealen A, Sorkine O, Alexa M, Cohen-Or D. A sketch-based interface for detail-preserving mesh editing. ACM Transactions on Graphics, 2005, 24(3): 1142–1147
https://doi.org/10.1145/1073204.1073324
27 Nam S H, Chai Y H. SPACESKETCH: shape modeling with 3D meshes and control curves in stereoscopic environments. Computers Graphics, 2012, 36(5): 526–533
https://doi.org/10.1016/j.cag.2012.03.012
28 Rivers A, Durand F, Igarashi T. 3D modeling with silhouettes. ACM Transactions on Graphics, 2010, 29(4): 109
https://doi.org/10.1145/1778765.1778846
29 Levi Z, Gotsman C. ArtiSketch: a system for articulated sketch modeling. Computer Graphics Forum, 2013, 32: 235–244
https://doi.org/10.1111/cgf.12043
30 Lee Y J, Zitnick C L, Cohen M F. Shadowdraw: real-time user guidance for freehand drawing. ACM Transactions on Graphics, 2011, 30(4): 27
https://doi.org/10.1145/2010324.1964922
31 Andre A, Saito S. Single-view sketch based modeling. In: Proceedings of the 8th ACM Eurographics Symposium on Sketch-Based Interfaces and Modeling. 2011, 133–140
https://doi.org/10.1145/2021164.2021189
32 Gingold Y, Igarashi T, Zorin D. Structured annotations for 2D-to-3D modeling. ACM Transactions on Graphics, 2009, 28(5): 148
https://doi.org/10.1145/1618452.1618494
33 Hoffman D D. Visual intelligence: how we create what we see. New York: W.W. Norton & Company, 2000
34 Xu B X, Chang W, Sheffer A, Bousseau A, McCrae J, Singh K. True2form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics, 2014, 33(4): 131
https://doi.org/10.1145/2601097.2601128
35 Schmidt R, Khan A, Singh K, Kurtenbach G. Analytic drawing of 3D scaffolds. ACM Transactions on Graphics, 2009, 28(5): 149
https://doi.org/10.1145/1618452.1618495
36 Zou M, Holloway M, Carr N, Ju T. Topology-constrained surface reconstruction from cross-sections. ACM Transactions on Graphics, 2015, 34(4): 128
https://doi.org/10.1145/2766976
37 Shtof A, Agathos A, Gingold Y, Shamir A, Cohen-or D. Geosemantic snapping for sketch-based modeling. Computer Graphics Forum, 2013, 32: 245–253
https://doi.org/10.1111/cgf.12044
38 Chen T, Zhu Z, Shamir A, Hu S M, Cohen-Or D. 3-sweep: extracting editable objects from a single photo. ACM Transactions on Graphics, 2013, 32(6): 195
https://doi.org/10.1145/2508363.2508378
39 Chen X J, Kang S B, Xu Y Q, Dorsey J, Shum H Y. Sketching reality: realistic interpretation of architectural designs. ACM Transactions on Graphics, 2008, 27(2): 11
https://doi.org/10.1145/1356682.1356684
40 Jiang N J, Tan P, Cheong L F. Symmetric architecture modeling with a single image. ACM Transactions on Graphics, 2009, 28(5): 113
https://doi.org/10.1145/1618452.1618459
41 Chen C J, Neubert B, Xu Y Q, Deussen O, Kang S B. Sketch-based tree modeling using Markov random field. ACM Transactions on Graphics, 2008, 27(5): 109
https://doi.org/10.1145/1409060.1409062
42 Tan P, Fang T, Xiao J X, Zhao P, Quan L. Single image tree modeling. ACM Transactions on Graphics, 2008, 27(5): 108
https://doi.org/10.1145/1409060.1409061
43 Davis J, Agrawala M, Chuang E, Popović Z, Salesin D. A sketching interface for articulated figure animation. In: Proceedings of the 2003 ACMSIGGRAPH/Eurographics Symposium on Computer Animation. 2003, 320–328
44 Kazmi I K, You L H, Yang X S, Jin X G, Zhang J J. Efficient sketchbased creation of detailed character models through data-driven mesh deformations. Computer Animation and Virtual Worlds, 2015, 26(3– 4): 469–481
45 Yan F L, Gong M L, Cohen-Or D, Deussen O, Chen N Q. Flower reconstruction from a single photo. Computer Graphics Forum. 2014, 33(2): 439–447
https://doi.org/10.1111/cgf.12332
46 Pan Z R, Huang J, Tong Y Y, Zheng C X, Bao H J. Interactive localized liquid motion editing. ACM Transactions on Graphics, 2013, 32(6): 184
https://doi.org/10.1145/2508363.2508429
47 Xu K, Kim V G, Huang Q X, Kalogerakis E. Data-driven shape analysis and processing. 2015, arXiv preprint arXiv:1502.06686
48 Shin H J, Igarashi T. Magic canvas: interactive design of a 3-D scene prototype from freehand sketches. In: Proceedings of Graphics Interface 2007. 2007, 63–70
49 Xu K, Zheng H L, Zhang H, Cohen-Or D, Liu L G, Xiong Y S. Photo-inspired model-driven 3D object modeling. ACM Transactions on Graphics, 2011, 30(4): 80
https://doi.org/10.1145/2010324.1964975
50 Su H, Huang Q X, Mitra N J, Li Y Y, Guibas L. Estimating image depth using shape collections. ACM Transactions on Graphics, 2014, 33(4):37
https://doi.org/10.1145/2601097.2601159
51 Xie X H, Xu K, Mitra N J, Cohen-Or D, Gong W Y, Su Q, Chen B Q. Sketch-to-design: context-based part assembly. Computer Graphics Forum, 2013, 32(8): 233–245
https://doi.org/10.1111/cgf.12200
52 Williams L R, Jacobs D W. Stochastic completion fields: a neural model of illusory contour shape and salience. Neural computation, 1997, 9(4): 837–858
https://doi.org/10.1162/neco.1997.9.4.837
53 Nealen A, Igarashi T, Sorkine O, Alexa M. Fibermesh: designing freeform surfaces with 3D curves. ACM Transactions on Graphics, 2007, 26(3): 41
https://doi.org/10.1145/1276377.1276429
54 Sorkine O, Cohen-Or D, Lipman Y, Alexa M, Rössl C, Seidel H P. Laplacian surface editing. In: Proceedings of the 2004 Eurographics/ ACM SIGGRAPH Symposium on Geometry Processing. 2004, 175–184
https://doi.org/10.1145/1057432.1057456
55 Pan H, Liu Y, Sheffer A, Vining N, Li C J, Wang W P. Flow aligned surfacing of curve networks. ACM Transactions on Graphics, 2015, 34(4): 127
https://doi.org/10.1145/2766990
56 Alexa M. Differential coordinates for local mesh morphing and deformation. The Visual Computer, 2003, 19(2): 105–114
57 De Paoli C, Singh K. SecondSkin: Sketch-based construction of layered 3D models. ACM Transactions on Graphics, 2015, 34(4): 126
https://doi.org/10.1145/2766948
58 Eitz M, Richter R, Boubekeur T, Hildebrand K, Alexa M. Sketch-based shape retrieval. ACM Transactions on Graphics, 2012, 31(4): 31
https://doi.org/10.1145/2185520.2185527
59 Funkhouser T, Kazhdan M, Shilane P, Min P, Kiefer W, Tal A, Rusinkiewicz S, Dobkin D. Modeling by example. ACM Transactions on Graphics, 2004, 23(3): 652–663
https://doi.org/10.1145/1015706.1015775
60 Eitz M, Hildebrand K, Boubekeur T, Alexa M. Sketch-based image retrieval: benchmark and bag-of-features descriptors. IEEE Transactions on Visualization and Computer Graphics, 2011, 17(11): 1624–1636
https://doi.org/10.1109/TVCG.2010.266
61 Eitz M, Hays J, Alexa M. How do humans sketch objects? ACMTransactions on Graphics, 2012, 31(4): 44
https://doi.org/10.1145/2185520.2185540
62 Schneider R G, Tuytelaars T. Sketch classification and classificationdriven analysis using fisher vectors. ACM Transactions on Graphics, 2014, 33(6): 174
https://doi.org/10.1145/2661229.2661231
[1]  Supplementary Material Download
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed