1. Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China 2. Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China 3. Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China 4. School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen 518055, China
Photomosaic images are composite images composed of many small images called tiles. In its overall visual effect, a photomosaic image is similar to the target image, and photomosaics are also called “montage art”. Noisy blocks and the loss of local information are the major obstacles in most methods or programs that create photomosaic images. To solve these problems and generate a photomosaic image in this study, we propose a tile selection method based on errorminimization. A photomosaic image can be generated by partitioning the target image in a rectangular pattern, selecting appropriate tile images, and then adding them with a weight coefficient. Based on the principles of montage art, the quality of the generated photomosaic image can be evaluated by both global and local error. Under the proposed framework, via an error function analysis, the results show that selecting a tile image using a global minimum distance minimizes both the global error and the local error simultaneously. Moreover, the weight coefficient of the image superposition can be used to adjust the ratio of the global and local errors. Finally, to verify the proposed method, we built a new photomosaic creation dataset during this study. The experimental results show that the proposed method achieves a lowmean absolute error and that the generated photomosaic images have a more artistic effect than do the existing approaches.
X Yang, T Mei, Y Q Xu, Y Rui, S Li. Automatic generation of visualtextual presentation layout. ACM Transactions on Multimedia Computing, Communications, and Applications, 2016, 12(2): 1–22 https://doi.org/10.1145/2818709
2
L A Gatys, A S Ecker, M Bethge. Image style transfer using convolutional neural networks. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2016, 2414–2423 https://doi.org/10.1109/CVPR.2016.265
3
P Gao, J Wu, Y Lin, Y Xia, T Mao. Fast Chinese calligraphic character recognition with large-scale data. Multimedia Tools and Applications, 2015, 74(17): 1–18 https://doi.org/10.1007/s11042-014-1969-3
4
S Seo, D Kang. A photomosaic image generation method using photo annotation in a social network environment. Multimedia Tools and Applications, 2016, 75(20): 12831–12841 https://doi.org/10.1007/s11042-015-2867-z
5
H Y Lee. Generation of photo-mosaic images through block matching and color adjustment. International Journal of Computer and Information Engineering, 2014, 8(3): 457–460
6
G D Blasi, M Petralia. Fast photomosaic. In: Proceedings of International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision. 2005, 1–2
7
N Deligiannis, B Comelis, M R Rodrigues, I Daubechies. Multi-modal dictionary learning for image separation with application in art investigation. IEEE Transactions on Image Processing, 2016, 26(2): 751–764 https://doi.org/10.1109/TIP.2016.2623484
8
C L Li, Y Su, R Z Wang. Extended photomosaic with QR code capability. In: Proceedings of IEEE International Conference on Multimedia and Expo Workshops. 2017, 345–350
9
R Silvers, H Michael. Photomosaics. New York: Henry Holt and Company, 1997
10
H Narasimhan, S Satheesh. A randomized iterative improvement algorithm for photomosaic generation. In: Proceedings of World Congress on Nature and Biologically Inspired Computing. 2009, 777–781 https://doi.org/10.1109/NABIC.2009.5393882
11
Y He, J Zhou, S Y Yuen. Composing photomosaic images using clustering based evolutionary programming. Multimedia Tools and Applications, 2019, 78(18): 25919–25936 https://doi.org/10.1007/s11042-019-07798-5
12
H Y Lee, Automatic photomosaic algorithm through adaptive tiling and block matching. Multimedia Tools and Applications, 2017, 76(22): 24281–24297 https://doi.org/10.1007/s11042-016-4175-7
13
M Fujisawa, T Amano, T Taketomi, G Yamamoto, Y Uranishi, J Miyazaki. Interactive photomosaic system using GPU. In: Proceedings of ACM International Conference on Multimedia. 2012, 1297–1298 https://doi.org/10.1145/2393347.2396451
14
Y Yang, Y Ito, K Nakano. Photomosaic generation by rearranging subimages, with GPU acceleration. In: Proceedings of IEEE International Parallel and Distributed Processing Symposium Workshops. 2017, 942–951 https://doi.org/10.1109/IPDPSW.2017.55
15
A S Chavan, A A Manjrekar. Data embedding technique using secret fragment visible mosaic image for covered communication. In: Proceedings of International Conference on Information Processing. 2016, 260–265 https://doi.org/10.1109/INFOP.2015.7489390
16
P William, J Lumsden, I T Nabney. The Mosaic test: measuring the effectiveness of colour-based image retrieval. Multimedia Tools and Applications, 2013, 64(3): 695–716 https://doi.org/10.1007/s11042-011-0951-6
17
D Chen, L Yuan, J Liao, N Yu, G Hua. StyleBank: an explicit representation for neural image style transfer. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2017, 2770–2779 https://doi.org/10.1109/CVPR.2017.296
M Xu, H Su, Y Li, X Li, J Liao, J Niu, P Lv, B Zhou. Stylized aesthetic QR code. IEEE Transactions on Multimedia, 2019, 21(8): 1960–1970 https://doi.org/10.1109/TMM.2019.2891420
20
Z Yu, L Lu, Y Yanwen Guo, R Fan, M Liu, W Wang. Content-aware photo collage using circle packing. IEEE Transactions on Visualization and Computer Graphics, 2014, 20(2): 182–195 https://doi.org/10.1109/TVCG.2013.106
21
L Liu, H Zhang, G Jing, Y Guo, Z Chen, W Wang. Correlation-preserving photo collage. IEEE Transactions on Visualization and Computer Graphics, 2018, 24(6): 1956–1968 https://doi.org/10.1109/TVCG.2017.2703853
22
J Wang, L Quan, J Sun, X Tang, H Y Shum. Picture collage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2006, 347–354
23
T Liu, J Wang, J Sun, N Zheng, X Xiaoou Tang, H Y Shum. Picture collage. IEEE Transactions on Multimedia, 2009, 11(7): 1225–1239 https://doi.org/10.1109/TMM.2009.2030741
24
F Fang, M Yi, H Feng, S Hu, C Xiao. Narrative collage of image collections by scene graph recombination. IEEE Transactions on Visualization and Computer Graphics, 2017, 24(9): 2559–2572 https://doi.org/10.1109/TVCG.2017.2759265
N Kumar, A C Berg, P N Belhumeur, S K Nayaret. Attribute and simile classifiers for face verification. In: Proceedings of IEEE International Conference on Computer Vision. 2009, 365–372 https://doi.org/10.1109/ICCV.2009.5459250