Research Article
Unusual Transformation: A Deep Learning Approach to Create Art
@INPROCEEDINGS{10.1007/978-3-030-95531-1_21, author={Mai Cong Hung and Mai Xuan Trang and Ryohei Nakatsu and Naoko Tosa}, title={Unusual Transformation: A Deep Learning Approach to Create Art}, proceedings={ArtsIT, Interactivity and Game Creation. Creative Heritage. New Perspectives from Media Arts and Artificial Intelligence. 10th EAI International Conference, ArtsIT 2021, Virtual Event, December 2-3, 2021, Proceedings}, proceedings_a={ARTSIT}, year={2022}, month={2}, keywords={GANs CycleGAN Image transformation Ikebana Shan-Shui UTGAN}, doi={10.1007/978-3-030-95531-1_21} }- Mai Cong Hung
Mai Xuan Trang
Ryohei Nakatsu
Naoko Tosa
Year: 2022
Unusual Transformation: A Deep Learning Approach to Create Art
ARTSIT
Springer
DOI: 10.1007/978-3-030-95531-1_21
Abstract
In this research, we proposed the concept of “unusual transformation,” which realizes transformation between two very different image sets as an extension of CycleGAN. CycleGAN is a new deep-learning-based AI technology that can realize transformation between two image sets. Although conventional CycleGAN researchers have tried transformation between two similar image sets, we applied CycleGAN to the transformation of two very different image sets such as between portraits photos and Ikebana or Shan-Shui paintings. Then to obtain a better result, we improved CycleGAN by adding a new loss function and developed “UTGAN (Unusual Transformation GAN).” We found that by using UTGAN, portrait photos and animal photos are transformed into Ikabana-like and Shan-Shui-like images. Then we carried out an analysis of the obtained result and made a hypothesis that the unusual transformation works well because both Ikebana and Shan-Shui are fundamental and abstracted expressions of nature. Also, we carried out various considerations to justify the hypothesis.
