|
|
Tile selection method based on error minimization for photomosaic image creation |
Hongbo ZHANG1,2,3( ), Xin GAO1,4, Jixiang DU1,2,3, Qing LEI1,2,3, Lijie YANG1,2,3 |
1. Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China 2. Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China 3. Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China 4. School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen 518055, China |
|
|
Abstract Photomosaic images are composite images composed of many small images called tiles. In its overall visual effect, a photomosaic image is similar to the target image, and photomosaics are also called “montage art”. Noisy blocks and the loss of local information are the major obstacles in most methods or programs that create photomosaic images. To solve these problems and generate a photomosaic image in this study, we propose a tile selection method based on errorminimization. A photomosaic image can be generated by partitioning the target image in a rectangular pattern, selecting appropriate tile images, and then adding them with a weight coefficient. Based on the principles of montage art, the quality of the generated photomosaic image can be evaluated by both global and local error. Under the proposed framework, via an error function analysis, the results show that selecting a tile image using a global minimum distance minimizes both the global error and the local error simultaneously. Moreover, the weight coefficient of the image superposition can be used to adjust the ratio of the global and local errors. Finally, to verify the proposed method, we built a new photomosaic creation dataset during this study. The experimental results show that the proposed method achieves a lowmean absolute error and that the generated photomosaic images have a more artistic effect than do the existing approaches.
|
Keywords
photomosaic image
tile image
target image
error minimization
mean absolute error
|
Corresponding Author(s):
Hongbo ZHANG
|
Just Accepted Date: 08 January 2020
Issue Date: 24 December 2020
|
|
1 |
X Yang, T Mei, Y Q Xu, Y Rui, S Li. Automatic generation of visualtextual presentation layout. ACM Transactions on Multimedia Computing, Communications, and Applications, 2016, 12(2): 1–22
https://doi.org/10.1145/2818709
|
2 |
L A Gatys, A S Ecker, M Bethge. Image style transfer using convolutional neural networks. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2016, 2414–2423
https://doi.org/10.1109/CVPR.2016.265
|
3 |
P Gao, J Wu, Y Lin, Y Xia, T Mao. Fast Chinese calligraphic character recognition with large-scale data. Multimedia Tools and Applications, 2015, 74(17): 1–18
https://doi.org/10.1007/s11042-014-1969-3
|
4 |
S Seo, D Kang. A photomosaic image generation method using photo annotation in a social network environment. Multimedia Tools and Applications, 2016, 75(20): 12831–12841
https://doi.org/10.1007/s11042-015-2867-z
|
5 |
H Y Lee. Generation of photo-mosaic images through block matching and color adjustment. International Journal of Computer and Information Engineering, 2014, 8(3): 457–460
|
6 |
G D Blasi, M Petralia. Fast photomosaic. In: Proceedings of International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision. 2005, 1–2
|
7 |
N Deligiannis, B Comelis, M R Rodrigues, I Daubechies. Multi-modal dictionary learning for image separation with application in art investigation. IEEE Transactions on Image Processing, 2016, 26(2): 751–764
https://doi.org/10.1109/TIP.2016.2623484
|
8 |
C L Li, Y Su, R Z Wang. Extended photomosaic with QR code capability. In: Proceedings of IEEE International Conference on Multimedia and Expo Workshops. 2017, 345–350
|
9 |
R Silvers, H Michael. Photomosaics. New York: Henry Holt and Company, 1997
|
10 |
H Narasimhan, S Satheesh. A randomized iterative improvement algorithm for photomosaic generation. In: Proceedings of World Congress on Nature and Biologically Inspired Computing. 2009, 777–781
https://doi.org/10.1109/NABIC.2009.5393882
|
11 |
Y He, J Zhou, S Y Yuen. Composing photomosaic images using clustering based evolutionary programming. Multimedia Tools and Applications, 2019, 78(18): 25919–25936
https://doi.org/10.1007/s11042-019-07798-5
|
12 |
H Y Lee, Automatic photomosaic algorithm through adaptive tiling and block matching. Multimedia Tools and Applications, 2017, 76(22): 24281–24297
https://doi.org/10.1007/s11042-016-4175-7
|
13 |
M Fujisawa, T Amano, T Taketomi, G Yamamoto, Y Uranishi, J Miyazaki. Interactive photomosaic system using GPU. In: Proceedings of ACM International Conference on Multimedia. 2012, 1297–1298
https://doi.org/10.1145/2393347.2396451
|
14 |
Y Yang, Y Ito, K Nakano. Photomosaic generation by rearranging subimages, with GPU acceleration. In: Proceedings of IEEE International Parallel and Distributed Processing Symposium Workshops. 2017, 942–951
https://doi.org/10.1109/IPDPSW.2017.55
|
15 |
A S Chavan, A A Manjrekar. Data embedding technique using secret fragment visible mosaic image for covered communication. In: Proceedings of International Conference on Information Processing. 2016, 260–265
https://doi.org/10.1109/INFOP.2015.7489390
|
16 |
P William, J Lumsden, I T Nabney. The Mosaic test: measuring the effectiveness of colour-based image retrieval. Multimedia Tools and Applications, 2013, 64(3): 695–716
https://doi.org/10.1007/s11042-011-0951-6
|
17 |
D Chen, L Yuan, J Liao, N Yu, G Hua. StyleBank: an explicit representation for neural image style transfer. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2017, 2770–2779
https://doi.org/10.1109/CVPR.2017.296
|
18 |
H K Chu, C S Chang, R R Lee, N J Mitra. Halftone QR codes. ACM Transactions on Graphics, 2013, 32(6): 217
https://doi.org/10.1145/2508363.2508408
|
19 |
M Xu, H Su, Y Li, X Li, J Liao, J Niu, P Lv, B Zhou. Stylized aesthetic QR code. IEEE Transactions on Multimedia, 2019, 21(8): 1960–1970
https://doi.org/10.1109/TMM.2019.2891420
|
20 |
Z Yu, L Lu, Y Yanwen Guo, R Fan, M Liu, W Wang. Content-aware photo collage using circle packing. IEEE Transactions on Visualization and Computer Graphics, 2014, 20(2): 182–195
https://doi.org/10.1109/TVCG.2013.106
|
21 |
L Liu, H Zhang, G Jing, Y Guo, Z Chen, W Wang. Correlation-preserving photo collage. IEEE Transactions on Visualization and Computer Graphics, 2018, 24(6): 1956–1968
https://doi.org/10.1109/TVCG.2017.2703853
|
22 |
J Wang, L Quan, J Sun, X Tang, H Y Shum. Picture collage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2006, 347–354
|
23 |
T Liu, J Wang, J Sun, N Zheng, X Xiaoou Tang, H Y Shum. Picture collage. IEEE Transactions on Multimedia, 2009, 11(7): 1225–1239
https://doi.org/10.1109/TMM.2009.2030741
|
24 |
F Fang, M Yi, H Feng, S Hu, C Xiao. Narrative collage of image collections by scene graph recombination. IEEE Transactions on Visualization and Computer Graphics, 2017, 24(9): 2559–2572
https://doi.org/10.1109/TVCG.2017.2759265
|
25 |
H W Kuhn. The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 1955, 2(1): 83–97
https://doi.org/10.1002/nav.3800020109
|
26 |
N Kumar, A C Berg, P N Belhumeur, S K Nayaret. Attribute and simile classifiers for face verification. In: Proceedings of IEEE International Conference on Computer Vision. 2009, 365–372
https://doi.org/10.1109/ICCV.2009.5459250
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|