Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Front. Comput. Sci.    2021, Vol. 15 Issue (3) : 153702    https://doi.org/10.1007/s11704-020-9242-6
RESEARCH ARTICLE
Tile selection method based on error minimization for photomosaic image creation
Hongbo ZHANG1,2,3(), Xin GAO1,4, Jixiang DU1,2,3, Qing LEI1,2,3, Lijie YANG1,2,3
1. Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
2. Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
3. Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
4. School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen 518055, China
 Download: PDF(876 KB)  
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

Photomosaic images are composite images composed of many small images called tiles. In its overall visual effect, a photomosaic image is similar to the target image, and photomosaics are also called “montage art”. Noisy blocks and the loss of local information are the major obstacles in most methods or programs that create photomosaic images. To solve these problems and generate a photomosaic image in this study, we propose a tile selection method based on errorminimization. A photomosaic image can be generated by partitioning the target image in a rectangular pattern, selecting appropriate tile images, and then adding them with a weight coefficient. Based on the principles of montage art, the quality of the generated photomosaic image can be evaluated by both global and local error. Under the proposed framework, via an error function analysis, the results show that selecting a tile image using a global minimum distance minimizes both the global error and the local error simultaneously. Moreover, the weight coefficient of the image superposition can be used to adjust the ratio of the global and local errors. Finally, to verify the proposed method, we built a new photomosaic creation dataset during this study. The experimental results show that the proposed method achieves a lowmean absolute error and that the generated photomosaic images have a more artistic effect than do the existing approaches.

Keywords photomosaic image      tile image      target image      error minimization      mean absolute error     
Corresponding Author(s): Hongbo ZHANG   
Just Accepted Date: 08 January 2020   Issue Date: 24 December 2020
 Cite this article:   
Hongbo ZHANG,Xin GAO,Jixiang DU, et al. Tile selection method based on error minimization for photomosaic image creation[J]. Front. Comput. Sci., 2021, 15(3): 153702.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-020-9242-6
https://academic.hep.com.cn/fcs/EN/Y2021/V15/I3/153702
1 X Yang, T Mei, Y Q Xu, Y Rui, S Li. Automatic generation of visualtextual presentation layout. ACM Transactions on Multimedia Computing, Communications, and Applications, 2016, 12(2): 1–22
https://doi.org/10.1145/2818709
2 L A Gatys, A S Ecker, M Bethge. Image style transfer using convolutional neural networks. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2016, 2414–2423
https://doi.org/10.1109/CVPR.2016.265
3 P Gao, J Wu, Y Lin, Y Xia, T Mao. Fast Chinese calligraphic character recognition with large-scale data. Multimedia Tools and Applications, 2015, 74(17): 1–18
https://doi.org/10.1007/s11042-014-1969-3
4 S Seo, D Kang. A photomosaic image generation method using photo annotation in a social network environment. Multimedia Tools and Applications, 2016, 75(20): 12831–12841
https://doi.org/10.1007/s11042-015-2867-z
5 H Y Lee. Generation of photo-mosaic images through block matching and color adjustment. International Journal of Computer and Information Engineering, 2014, 8(3): 457–460
6 G D Blasi, M Petralia. Fast photomosaic. In: Proceedings of International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision. 2005, 1–2
7 N Deligiannis, B Comelis, M R Rodrigues, I Daubechies. Multi-modal dictionary learning for image separation with application in art investigation. IEEE Transactions on Image Processing, 2016, 26(2): 751–764
https://doi.org/10.1109/TIP.2016.2623484
8 C L Li, Y Su, R Z Wang. Extended photomosaic with QR code capability. In: Proceedings of IEEE International Conference on Multimedia and Expo Workshops. 2017, 345–350
9 R Silvers, H Michael. Photomosaics. New York: Henry Holt and Company, 1997
10 H Narasimhan, S Satheesh. A randomized iterative improvement algorithm for photomosaic generation. In: Proceedings of World Congress on Nature and Biologically Inspired Computing. 2009, 777–781
https://doi.org/10.1109/NABIC.2009.5393882
11 Y He, J Zhou, S Y Yuen. Composing photomosaic images using clustering based evolutionary programming. Multimedia Tools and Applications, 2019, 78(18): 25919–25936
https://doi.org/10.1007/s11042-019-07798-5
12 H Y Lee, Automatic photomosaic algorithm through adaptive tiling and block matching. Multimedia Tools and Applications, 2017, 76(22): 24281–24297
https://doi.org/10.1007/s11042-016-4175-7
13 M Fujisawa, T Amano, T Taketomi, G Yamamoto, Y Uranishi, J Miyazaki. Interactive photomosaic system using GPU. In: Proceedings of ACM International Conference on Multimedia. 2012, 1297–1298
https://doi.org/10.1145/2393347.2396451
14 Y Yang, Y Ito, K Nakano. Photomosaic generation by rearranging subimages, with GPU acceleration. In: Proceedings of IEEE International Parallel and Distributed Processing Symposium Workshops. 2017, 942–951
https://doi.org/10.1109/IPDPSW.2017.55
15 A S Chavan, A A Manjrekar. Data embedding technique using secret fragment visible mosaic image for covered communication. In: Proceedings of International Conference on Information Processing. 2016, 260–265
https://doi.org/10.1109/INFOP.2015.7489390
16 P William, J Lumsden, I T Nabney. The Mosaic test: measuring the effectiveness of colour-based image retrieval. Multimedia Tools and Applications, 2013, 64(3): 695–716
https://doi.org/10.1007/s11042-011-0951-6
17 D Chen, L Yuan, J Liao, N Yu, G Hua. StyleBank: an explicit representation for neural image style transfer. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2017, 2770–2779
https://doi.org/10.1109/CVPR.2017.296
18 H K Chu, C S Chang, R R Lee, N J Mitra. Halftone QR codes. ACM Transactions on Graphics, 2013, 32(6): 217
https://doi.org/10.1145/2508363.2508408
19 M Xu, H Su, Y Li, X Li, J Liao, J Niu, P Lv, B Zhou. Stylized aesthetic QR code. IEEE Transactions on Multimedia, 2019, 21(8): 1960–1970
https://doi.org/10.1109/TMM.2019.2891420
20 Z Yu, L Lu, Y Yanwen Guo, R Fan, M Liu, W Wang. Content-aware photo collage using circle packing. IEEE Transactions on Visualization and Computer Graphics, 2014, 20(2): 182–195
https://doi.org/10.1109/TVCG.2013.106
21 L Liu, H Zhang, G Jing, Y Guo, Z Chen, W Wang. Correlation-preserving photo collage. IEEE Transactions on Visualization and Computer Graphics, 2018, 24(6): 1956–1968
https://doi.org/10.1109/TVCG.2017.2703853
22 J Wang, L Quan, J Sun, X Tang, H Y Shum. Picture collage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2006, 347–354
23 T Liu, J Wang, J Sun, N Zheng, X Xiaoou Tang, H Y Shum. Picture collage. IEEE Transactions on Multimedia, 2009, 11(7): 1225–1239
https://doi.org/10.1109/TMM.2009.2030741
24 F Fang, M Yi, H Feng, S Hu, C Xiao. Narrative collage of image collections by scene graph recombination. IEEE Transactions on Visualization and Computer Graphics, 2017, 24(9): 2559–2572
https://doi.org/10.1109/TVCG.2017.2759265
25 H W Kuhn. The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 1955, 2(1): 83–97
https://doi.org/10.1002/nav.3800020109
26 N Kumar, A C Berg, P N Belhumeur, S K Nayaret. Attribute and simile classifiers for face verification. In: Proceedings of IEEE International Conference on Computer Vision. 2009, 365–372
https://doi.org/10.1109/ICCV.2009.5459250
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed