Abstract
In this paper, we present a series of demonstrations for artistic portrait drawing generation (APDG), including an applet, a robot, and a printer. To this end, we develop novel APDG algorithms which can translate a facial photo into high quality portraits of five artistic styles, i.e. the line-drawing, pen-drawing, pencil-drawing, abstract-drawing, and cartoon. Besides, we provide a number of templates to post-process the generated portraits. By simply pressing several buttons, users can obtain artistic portraits in the applet and order the robot/printer to draw/print them on beautiful postcards. The whole procedure only consumes about 2 min. Our demonstrations are easy to use and have achieved excellent user experience in various exhibitions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Asadi, E., Li, B., Chen, I.M.: Pictobot: a cooperative painting robot for interior finishing of industrial developments. IEEE Robot. Autom. Mag. 25(2), 82–94 (2018)
Cao, B., Wang, N., Li, J., Hu, Q., Gao, X.: Face photo-sketch synthesis via full-scale identity supervision. Pattern Recogn. 124, 108446 (2022)
Cao, N., Yan, X., Shi, Y., Chen, C.: AI-sketcher: a deep generative model for producing high-quality sketches. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 33, 2564–2571 (2019)
Cheng, T., Wang, X., Huang, L., Liu, W.: Boundary-preserving mask R-CNN. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12359, pp. 660–676. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58568-6_39
Deng-Ping, F., Ziling, H., Peng, Z., Hong, L., Xuebin, Q., Luc, V.G.: Deep facial synthesis: A new challenge. arXiv (2021)
Gao, F., Zhu, J., Yu, Z., Li, P., Wang, T.: Making robots draw a vivid portrait in two minutes. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 9585–9591. IEEE (2020)
Gatys, L., Ecker, A., Bethge, M.: A neural algorithm of artistic style. J. Vis. 16(12), 326–326 (2016)
Gui, J., Sun, Z., Wen, Y., Tao, D., Ye, J.: A review on generative adversarial networks: algorithms, theory, and applications. IEEE Trans. Knowl. Data Eng. 1–1 (2021)
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1125–1134 (2017)
Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., Song, M.: Neural style transfer: a review. IEEE Trans. Visual. Comput. Graphics 26(11), 3365–3385 (2019)
Kim, J., Kim, M., Kang, H., Lee, K.H.: U-GAT-IT: unsupervised generative attentional networks with adaptive layer-instance normalization for image-to-image translation. In: International Conference on Learning Representations (2019)
Li, X., Gao, F., Huang, F.: High-quality face sketch synthesis via geometric normalization and regularization. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2021)
Pang, Y., Lin, J., Qin, T., Chen, Z.: Image-to-image translation: methods and applications. IEEE Trans. Multimedia (2021)
Qi, X., Sun, M., Li, Q., Shan, C.: Biphasic face photo-sketch synthesis via semantic-driven generative adversarial network with graph representation learning. arXiv preprint arXiv:2201.01592 (2022)
Qin, X., Zhang, Z., Huang, C., Dehghan, M., Zaiane, O.R., Jagersand, M.: U2-Net: going deeper with nested U-structure for salient object detection. Pattern Recogn. 106, 107404 (2020)
Su, H., Niu, J., Liu, X., Li, Q., Cui, J., Wan, J.: MangaGan: unpaired photo-to-manga translation based on the methodology of manga drawing. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 35, pp. 2611–2619 (2021)
Wang, T.C., Liu, M.Y., Zhu, J.Y., Tao, A., Kautz, J., Catanzaro, B.: High-resolution image synthesis and semantic manipulation with conditional GANs, pp. 8798–8807 (2018)
Yang, S., Jiang, L., Liu, Z., Loy, C.C.: Pastiche master: exemplar-based high-resolution portrait style transfer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7693–7702 (2022)
Yi, R., Liu, Y.J.: Multi-style artistic portrait drawing generation. In: 2021 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–2. IEEE (2021)
Yi, R., Liu, Y.J., Lai, Y.K., Rosin, P.L.: APDrawingGAN: generating artistic portrait drawings from face photos with hierarchical GANs. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019), pp. 10743–10752 (2019)
Yi, R., Liu, Y.J., Lai, Y.K., Rosin, P.L.: Unpaired portrait drawing generation via asymmetric cycle mapping. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020), pp. 8214–8222 (2020)
Yi, R., Liu, Y.J., Lai, Y.K., Rosin, P.L.: Quality metric guided portrait line drawing generation from unpaired training data. IEEE Trans. Pattern Anal. Mach. Intell. (2022). https://doi.org/10.1109/TPAMI.2022.3147570
Yi, R., Xia, M., Liu, Y.J., Lai, Y.K., Rosin, P.L.: Line drawings for face portraits from photos using global and local structure based GANs. IEEE Trans. Pattern Anal. Mach. Intell. 43(10), 3462–3475 (2020)
Yu, J., et al.: Toward realistic face photo-sketch synthesis via composition-aided GANs. IEEE Trans. Cybern. 51(9), 4350–4362 (2020)
Zhang, M., Wang, N., Li, Y., Gao, X.: Bionic face sketch generator. IEEE Trans. Cybern. 50(6), 2701–2714 (2019)
Zhou, X., et al.: CoCosNet v2: full-resolution correspondence learning for image translation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11465–11475 (2021)
Zhu, M., Li, J., Wang, N., Gao, X.: A deep collaborative framework for face photo-sketch synthesis. IEEE Trans. Neural Netw. Learn. Syst. 30(10), 3096–3108 (2019)
Acknowledgement
This work was supported by the National Natural Science Foundation of China under Grant No. 61971172, and the Hangzhou Science and Technology Development Program under Grant No. 20200401B20.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhu, J. et al. (2022). Artistic Portrait Applet, Robot, and Printer. In: Fang, L., Povey, D., Zhai, G., Mei, T., Wang, R. (eds) Artificial Intelligence. CICAI 2022. Lecture Notes in Computer Science(), vol 13606. Springer, Cham. https://doi.org/10.1007/978-3-031-20503-3_58
Download citation
DOI: https://doi.org/10.1007/978-3-031-20503-3_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20502-6
Online ISBN: 978-3-031-20503-3
eBook Packages: Computer ScienceComputer Science (R0)