|
|
|
A survey of sketch based modeling systems |
Chao DING,Ligang LIU( ) |
| School of Mathematical Sciences, University of Science and Technology of China, Hefei 230026, China |
|
|
|
|
Abstract As 3D technology, including computer graphics, virtual reality and 3D printing, has been rapidly developed in the past years, 3D models are gaining an increasingly huge demand. Traditional 3D modeling platforms such as Maya and ZBrush, utilize “windows, icons, menus, pointers” (WIMP) interface paradigms for fine-grained control to construct detailed models. However, the modeling progress can be tedious and frustrating and thus too hard for a novice user or even a well trained artist. Therefore, a more intuitive interface is needed. Sketch, an intuitive communication and modeling tool for human beings, becomes the first choice of modeling community. So far, various sketch-based modeling systems have been created and studied. In this paper, we attempt to show how these systems work and give a comprehensive survey. We review and categorize the systems in four aspects: the input, the knowledge they use, the modeling approach and the output. We also discuss about inherent challenges and open problems for researchers in the future.
|
| Keywords
sketch-based modeling
interactive design
sketch comprehension
|
|
Corresponding Author(s):
Ligang LIU
|
|
Just Accepted Date: 17 June 2016
Online First Date: 25 July 2016
Issue Date: 11 October 2016
|
|
| 1 |
Botsch M, Pauly M, Kobbelt L, Alliez P, Lévy B, Bischoff S, Röossl C. Geometric modeling based on polygonal meshes. In: Proceedings of the ACM SIGGRAPH Course Notes. 2007
https://doi.org/10.1145/1281500.1281640
|
| 2 |
Perry R N, Frisken S F. Kizamu: a system for sculpting digital characters. In: Proceedings of the 28th ACM Annual Conference on Computer Graphics and Interactive Techniques. 2001, 47–56
https://doi.org/10.1145/383259.383264
|
| 3 |
Zoran A, Shilkrot R, Nanyakkara S, Paradiso J. The hybrid artisans: a case study in smart tools. ACM Transactions on Computer-Human Interaction, 2014, 21(3): 15
https://doi.org/10.1145/2617570
|
| 4 |
Shotton J, Sharp T, Kipman A, Fitzgibbon A, Finocchio M, Blake A, Cook M, Moore R. Real-time human pose recognition in parts from single depth images. Communications of the ACM, 2013, 56(1): 116–124
https://doi.org/10.1145/2398356.2398381
|
| 5 |
Henry P, Krainin M, Herbst E, Ren X F, Fox D. RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research, 2012, 31(5): 647–663
https://doi.org/10.1177/0278364911434148
|
| 6 |
Smisek J, Jancosek M, Pajdla T. 3D with kinect. In: Fossati A, Gall J, Helmut Grabner H, . <Eds/>. Consumer Depth Cameras for Computer Vision: Research Topics and Applications. London: Springer-Verlag, 2013, 3–25
https://doi.org/10.1007/978-1-4471-4640-7_1
|
| 7 |
Quan L. Image-based modeling. Springer Science & Business Media, 2010
https://doi.org/10.1007/978-1-4419-6679-7
|
| 8 |
Fan L B, Wang R M, Xu L L, Deng J S, Liu L G. Modeling by drawing with shadow guidance. Computer Graphics Forum, 2013, 23(7): 157–166
https://doi.org/10.1111/cgf.12223
|
| 9 |
Yuan X R, Xu H, Nguyen M, Shesh A, Chen B Q. Sketch-based segmentation of scanned outdoor environment models. In: Proceedings of EG Workshop on Sketch-Based Interfaces and Modeling. 2005, 19–26
|
| 10 |
Wu H Y, Pan C H, Pan J, Yang Q, Ma S D. A sketch-based interactive framework for real-time mesh segmentation. In: Proceedings of Computer Graphics International. 2007
|
| 11 |
Schmidt R, Wyvill B, Sousa M C, Jorge J A. Shapeshop: sketch-based solid modeling with blobtrees. In: Proceedings of ACM SIGGRAPH 2007 courses. 2007
https://doi.org/10.1145/1281500.1281554
|
| 12 |
Turquin E, Wither J, Boissieux L, Cani M P, Hughes J F. A sketchbased interface for clothing virtual characters. IEEE Computer Graphics and Applications, 2007, 27(1): 72–81
https://doi.org/10.1109/MCG.2007.1
|
| 13 |
Igarashi T, Matsuoka S, Tanaka H. Teddy: a sketching interface for 3D freeform design. In: Proceedings of the 26th ACM Annual Conference on Computer Graphics and Interactive Techniques. 1999, 409–416
https://doi.org/10.1145/311535.311602
|
| 14 |
Olsen L, Samavati F F, Sousa M C, Jorge J A. Sketch-based modeling: a survey. Computers & Graphics, 2009, 33(1): 85–103
https://doi.org/10.1016/j.cag.2008.09.013
|
| 15 |
Cook M T, Agah A. A survey of sketch-based 3-D modeling techniques. Interacting with Computers, 2009, 21(3): 201–211
https://doi.org/10.1016/j.intcom.2009.05.004
|
| 16 |
Kho Y, Garland M. Sketching mesh deformations. In: Proceedings of ACM SIGGRAPH 2007 Courses. 2007
https://doi.org/10.1145/1281500.1281552
|
| 17 |
Karpenko O A, Hughes J F. Smoothsketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics, 2006, 25(3): 589–598
https://doi.org/10.1145/1141911.1141928
|
| 18 |
Xu K, Chen K, Fu H B, Sun W K L, Hu S M. Sketch2Scene: sketchbased co-retrieval and co-placement of 3D models. ACM Transactions on Graphics, 2013, 32(4): 123
https://doi.org/10.1145/2461912.2461968
|
| 19 |
Iarussi E, Bommes D, Bousseau A. Bendfields: regularized curvature fields from rough concept sketches. ACM Transactions on Graphics, 2015, 34(3): 24
https://doi.org/10.1145/2710026
|
| 20 |
Bae S H, Balakrishnan R, Singh K. ILoveSketch: as-natural-aspossible sketching system for creating 3D curve models. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology. 2008, 151–160
https://doi.org/10.1145/1449715.1449740
|
| 21 |
Lee S, Feng D, Grimm C, Gooch B. A sketch-based user interface for reconstructing architectural drawings. Computer Graphics Forum, 2008, 27(1): 81–90
https://doi.org/10.1111/j.1467-8659.2007.01098.x
|
| 22 |
Bae S H, Balakrishnan R, Singh K. EverybodyLovesSketch: 3D sketching for a broader audience. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. 2009, 59–68
https://doi.org/10.1145/1622176.1622189
|
| 23 |
Zimmermann J, Nealen A, Alexa M. SilSketch: automated sketchbased editing of surface meshes. In: Proceedings of the 4th Eurographics Workshop on Sketch-based Interfaces and Modeling. 2007, 23–30
https://doi.org/10.1145/1384429.1384438
|
| 24 |
Zimmermann J, Nealen A, Alexa M. Sketchbased interfaces: sketching contours. Computers Graphics, 2008, 32(5): 486–499
https://doi.org/10.1016/j.cag.2008.05.006
|
| 25 |
Kraevoy V, Sheffer A, van de Panne M. Modeling from contour drawings. In: Proceedings of the 6th ACM Eurographics Symposium on Sketch-Based Interfaces and Modeling. 2009, 37–44
https://doi.org/10.1145/1572741.1572749
|
| 26 |
Nealen A, Sorkine O, Alexa M, Cohen-Or D. A sketch-based interface for detail-preserving mesh editing. ACM Transactions on Graphics, 2005, 24(3): 1142–1147
https://doi.org/10.1145/1073204.1073324
|
| 27 |
Nam S H, Chai Y H. SPACESKETCH: shape modeling with 3D meshes and control curves in stereoscopic environments. Computers Graphics, 2012, 36(5): 526–533
https://doi.org/10.1016/j.cag.2012.03.012
|
| 28 |
Rivers A, Durand F, Igarashi T. 3D modeling with silhouettes. ACM Transactions on Graphics, 2010, 29(4): 109
https://doi.org/10.1145/1778765.1778846
|
| 29 |
Levi Z, Gotsman C. ArtiSketch: a system for articulated sketch modeling. Computer Graphics Forum, 2013, 32: 235–244
https://doi.org/10.1111/cgf.12043
|
| 30 |
Lee Y J, Zitnick C L, Cohen M F. Shadowdraw: real-time user guidance for freehand drawing. ACM Transactions on Graphics, 2011, 30(4): 27
https://doi.org/10.1145/2010324.1964922
|
| 31 |
Andre A, Saito S. Single-view sketch based modeling. In: Proceedings of the 8th ACM Eurographics Symposium on Sketch-Based Interfaces and Modeling. 2011, 133–140
https://doi.org/10.1145/2021164.2021189
|
| 32 |
Gingold Y, Igarashi T, Zorin D. Structured annotations for 2D-to-3D modeling. ACM Transactions on Graphics, 2009, 28(5): 148
https://doi.org/10.1145/1618452.1618494
|
| 33 |
Hoffman D D. Visual intelligence: how we create what we see. New York: W.W. Norton & Company, 2000
|
| 34 |
Xu B X, Chang W, Sheffer A, Bousseau A, McCrae J, Singh K. True2form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics, 2014, 33(4): 131
https://doi.org/10.1145/2601097.2601128
|
| 35 |
Schmidt R, Khan A, Singh K, Kurtenbach G. Analytic drawing of 3D scaffolds. ACM Transactions on Graphics, 2009, 28(5): 149
https://doi.org/10.1145/1618452.1618495
|
| 36 |
Zou M, Holloway M, Carr N, Ju T. Topology-constrained surface reconstruction from cross-sections. ACM Transactions on Graphics, 2015, 34(4): 128
https://doi.org/10.1145/2766976
|
| 37 |
Shtof A, Agathos A, Gingold Y, Shamir A, Cohen-or D. Geosemantic snapping for sketch-based modeling. Computer Graphics Forum, 2013, 32: 245–253
https://doi.org/10.1111/cgf.12044
|
| 38 |
Chen T, Zhu Z, Shamir A, Hu S M, Cohen-Or D. 3-sweep: extracting editable objects from a single photo. ACM Transactions on Graphics, 2013, 32(6): 195
https://doi.org/10.1145/2508363.2508378
|
| 39 |
Chen X J, Kang S B, Xu Y Q, Dorsey J, Shum H Y. Sketching reality: realistic interpretation of architectural designs. ACM Transactions on Graphics, 2008, 27(2): 11
https://doi.org/10.1145/1356682.1356684
|
| 40 |
Jiang N J, Tan P, Cheong L F. Symmetric architecture modeling with a single image. ACM Transactions on Graphics, 2009, 28(5): 113
https://doi.org/10.1145/1618452.1618459
|
| 41 |
Chen C J, Neubert B, Xu Y Q, Deussen O, Kang S B. Sketch-based tree modeling using Markov random field. ACM Transactions on Graphics, 2008, 27(5): 109
https://doi.org/10.1145/1409060.1409062
|
| 42 |
Tan P, Fang T, Xiao J X, Zhao P, Quan L. Single image tree modeling. ACM Transactions on Graphics, 2008, 27(5): 108
https://doi.org/10.1145/1409060.1409061
|
| 43 |
Davis J, Agrawala M, Chuang E, Popović Z, Salesin D. A sketching interface for articulated figure animation. In: Proceedings of the 2003 ACMSIGGRAPH/Eurographics Symposium on Computer Animation. 2003, 320–328
|
| 44 |
Kazmi I K, You L H, Yang X S, Jin X G, Zhang J J. Efficient sketchbased creation of detailed character models through data-driven mesh deformations. Computer Animation and Virtual Worlds, 2015, 26(3– 4): 469–481
|
| 45 |
Yan F L, Gong M L, Cohen-Or D, Deussen O, Chen N Q. Flower reconstruction from a single photo. Computer Graphics Forum. 2014, 33(2): 439–447
https://doi.org/10.1111/cgf.12332
|
| 46 |
Pan Z R, Huang J, Tong Y Y, Zheng C X, Bao H J. Interactive localized liquid motion editing. ACM Transactions on Graphics, 2013, 32(6): 184
https://doi.org/10.1145/2508363.2508429
|
| 47 |
Xu K, Kim V G, Huang Q X, Kalogerakis E. Data-driven shape analysis and processing. 2015, arXiv preprint arXiv:1502.06686
|
| 48 |
Shin H J, Igarashi T. Magic canvas: interactive design of a 3-D scene prototype from freehand sketches. In: Proceedings of Graphics Interface 2007. 2007, 63–70
|
| 49 |
Xu K, Zheng H L, Zhang H, Cohen-Or D, Liu L G, Xiong Y S. Photo-inspired model-driven 3D object modeling. ACM Transactions on Graphics, 2011, 30(4): 80
https://doi.org/10.1145/2010324.1964975
|
| 50 |
Su H, Huang Q X, Mitra N J, Li Y Y, Guibas L. Estimating image depth using shape collections. ACM Transactions on Graphics, 2014, 33(4):37
https://doi.org/10.1145/2601097.2601159
|
| 51 |
Xie X H, Xu K, Mitra N J, Cohen-Or D, Gong W Y, Su Q, Chen B Q. Sketch-to-design: context-based part assembly. Computer Graphics Forum, 2013, 32(8): 233–245
https://doi.org/10.1111/cgf.12200
|
| 52 |
Williams L R, Jacobs D W. Stochastic completion fields: a neural model of illusory contour shape and salience. Neural computation, 1997, 9(4): 837–858
https://doi.org/10.1162/neco.1997.9.4.837
|
| 53 |
Nealen A, Igarashi T, Sorkine O, Alexa M. Fibermesh: designing freeform surfaces with 3D curves. ACM Transactions on Graphics, 2007, 26(3): 41
https://doi.org/10.1145/1276377.1276429
|
| 54 |
Sorkine O, Cohen-Or D, Lipman Y, Alexa M, Rössl C, Seidel H P. Laplacian surface editing. In: Proceedings of the 2004 Eurographics/ ACM SIGGRAPH Symposium on Geometry Processing. 2004, 175–184
https://doi.org/10.1145/1057432.1057456
|
| 55 |
Pan H, Liu Y, Sheffer A, Vining N, Li C J, Wang W P. Flow aligned surfacing of curve networks. ACM Transactions on Graphics, 2015, 34(4): 127
https://doi.org/10.1145/2766990
|
| 56 |
Alexa M. Differential coordinates for local mesh morphing and deformation. The Visual Computer, 2003, 19(2): 105–114
|
| 57 |
De Paoli C, Singh K. SecondSkin: Sketch-based construction of layered 3D models. ACM Transactions on Graphics, 2015, 34(4): 126
https://doi.org/10.1145/2766948
|
| 58 |
Eitz M, Richter R, Boubekeur T, Hildebrand K, Alexa M. Sketch-based shape retrieval. ACM Transactions on Graphics, 2012, 31(4): 31
https://doi.org/10.1145/2185520.2185527
|
| 59 |
Funkhouser T, Kazhdan M, Shilane P, Min P, Kiefer W, Tal A, Rusinkiewicz S, Dobkin D. Modeling by example. ACM Transactions on Graphics, 2004, 23(3): 652–663
https://doi.org/10.1145/1015706.1015775
|
| 60 |
Eitz M, Hildebrand K, Boubekeur T, Alexa M. Sketch-based image retrieval: benchmark and bag-of-features descriptors. IEEE Transactions on Visualization and Computer Graphics, 2011, 17(11): 1624–1636
https://doi.org/10.1109/TVCG.2010.266
|
| 61 |
Eitz M, Hays J, Alexa M. How do humans sketch objects? ACMTransactions on Graphics, 2012, 31(4): 44
https://doi.org/10.1145/2185520.2185540
|
| 62 |
Schneider R G, Tuytelaars T. Sketch classification and classificationdriven analysis using fisher vectors. ACM Transactions on Graphics, 2014, 33(6): 174
https://doi.org/10.1145/2661229.2661231
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
