References

Alain, Guillaume, and Yoshua Bengio. 2014. “What Regularized Auto-Encoders Learn from the Data-Generating Distribution.” Journal of Machine Learning Research 15: 3563–93.

Alharbi, Yazeed, and Peter Wonka. 2020. “Disentangled Image Generation Through Structured Noise Injection.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/2004.12411.

Arjovsky, Martin, and Léon Bottou. 2017. “Towards Principled Methods for Training Generative Adversarial Networks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1701.04862.

Arjovsky, Martin, Soumith Chintala, and Léon Bottou. 2017. “Wasserstein Generative Adversarial Networks.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1701.07875.

Arora, Sanjeev, Rong Ge, Yingyu Liang, Tengyu Ma, and Yi Zhang. 2017. “Generalization and Equilibrium in Generative Adversarial Nets (GANs).” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1703.00573.

Ba, Jimmy Lei, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer Normalization. https://arxiv.org/abs/1607.06450.

Batson, Joshua, and Loic Royer. 2019. “Noise2Self: Blind Denoising by Self-Supervision.” International Conference on Machine Learning (ICML).

Brenier, Yann. 1991. “Polar Factorization and Monotone Rearrangement of Vector-Valued Functions.” Communications on Pure and Applied Mathematics 44 (4): 375–417.

Broaddus, Coleman, Alexander Krull, Martin Weigert, Uwe Schmidt, and Gene Myers. 2020. “Removing Structured Noise with Self-Supervised Blind-Spot Networks.” IEEE International Symposium on Biomedical Imaging (ISBI).

Burgess, Christopher P., Irina Higgins, Arka Pal, et al. 2018. Understanding Disentangling in Beta-VAE. https://arxiv.org/abs/1804.03599.

Chen, Xi, Yan Duan, Rein Houthooft, John Schulman, Ilya Sutskever, and Pieter Abbeel. 2016. “InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1606.03657.

Choi, Yunjey, Minje Choi, Munyoung Kim, Jung-Woo Ha, Sunghun Kim, and Jaegul Choo. 2018. “StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1711.09020.

Choi, Yunjey, Youngjung Uh, Jaejun Yoo, and Jung-Woo Ha. 2020. “StarGAN V2: Diverse Image Synthesis for Multiple Domains.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1912.01865.

Chu, Casey, Andrey Zhmoginov, and Mark Sandler. 2017. CycleGAN, a Master of Steganography. https://arxiv.org/abs/1712.02950.

Csiszár, Imre. 1967. “Information-Type Measures of Difference of Probability Distributions and Indirect Observations.” Studia Scientiarum Mathematicarum Hungarica 2: 299–318.

Dabov, Kostadin, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. “Image Denoising by Sparse 3-d Transform-Domain Collaborative Filtering.” IEEE Transactions on Image Processing 16 (8): 2080–95.

Dinh, Laurent, David Krueger, and Yoshua Bengio. 2015. “NICE: Non-Linear Independent Components Estimation.” International Conference on Learning Representations (ICLR), Workshop Track. https://arxiv.org/abs/1410.8516.

Dinh, Laurent, Jascha Sohl-Dickstein, and Samy Bengio. 2017. “Density Estimation Using Real NVP.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1605.08803.

Efron, Bradley. 2011. “Tweedie’s Formula and Selection Bias.” Journal of the American Statistical Association 106 (496): 1602–14.

Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks.

Goodfellow, Ian J., Jean Pouget-Abadie, Mehdi Mirza, et al. 2014. “Generative Adversarial Nets.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1406.2661.

Gretton, Arthur, Karsten M. Borgwardt, Malte J. Rasch, Bernhard Schölkopf, and Alexander Smola. 2012. “A Kernel Two-Sample Test.” Journal of Machine Learning Research 13: 723–73.

Gulrajani, Ishaan, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville. 2017. “Improved Training of Wasserstein GANs.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1704.00028.

He, Junxian, Daniel Spokoyny, Graham Neubig, and Taylor Berg-Kirkpatrick. 2019. “Lagging Inference Networks and Posterior Collapse in Variational Autoencoders.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1901.05534.

Heusel, Martin, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. “GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1706.08500.

Higgins, Irina, Loïc Matthey, Arka Pal, et al. 2017. “Beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework.” International Conference on Learning Representations (ICLR).

Ho, Jonathan, Ajay Jain, and Pieter Abbeel. 2020. “Denoising Diffusion Probabilistic Models.” Advances in Neural Information Processing Systems (NeurIPS).

Hu, Jie, Li Shen, and Gang Sun. 2018. “Squeeze-and-Excitation Networks.” IEEE Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1709.01507.

Huang, Xun, and Serge Belongie. 2017. “Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization.” IEEE International Conference on Computer Vision (ICCV). https://arxiv.org/abs/1703.06868.

Hyvarinen, Aapo. 2005. “Estimation of Non-Normalized Statistical Models by Score Matching.” Journal of Machine Learning Research 6: 695–709.

Ioffe, Sergey, and Christian Szegedy. 2015. “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1502.03167.

Isola, Phillip, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. “Image-to-Image Translation with Conditional Adversarial Networks.” IEEE Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1611.07004.

Karras, Tero, Samuli Laine, and Timo Aila. 2019. “A Style-Based Generator Architecture for Generative Adversarial Networks.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1812.04948.

Karras, Tero, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2020. “Analyzing and Improving the Image Quality of StyleGAN.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1912.04958.

Kim, Kwanyoung, and Jong Chul Ye. 2021. “Noise2Score: Tweedie’s Approach to Self-Supervised Image Denoising Without Clean Images.” Advances in Neural Information Processing Systems (NeurIPS).

Kim, Taeksoo, Moonsu Cha, Hyunsoo Kim, Jung Kwon Lee, and Jiwon Kim. 2017. “Learning to Discover Cross-Domain Relations with Generative Adversarial Networks.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1703.05192.

Kingma, Diederik P., and Prafulla Dhariwal. 2018. “Glow: Generative Flow with Invertible 1x1 Convolutions.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1807.03039.

Kingma, Diederik P., Tim Salimans, Rafal Jozefowicz, Xi Chen, Ilya Sutskever, and Max Welling. 2016. “Improved Variational Inference with Inverse Autoregressive Flow.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1606.04934.

Kingma, Diederik P., Tim Salimans, Ben Poole, and Jonathan Ho. 2021. “Variational Diffusion Models.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2107.00630.

Kingma, Diederik P., and Max Welling. 2014. “Auto-Encoding Variational Bayes.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1312.6114.

Krull, Alexander, Tim-Oliver Buchholz, and Florian Jug. 2019. “Noise2Void — Learning Denoising from Single Noisy Images.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

Kwon, Gihyun, and Jong Chul Ye. 2021. “Diagonal Attention and Style-Based GAN for Content-Style Disentanglement in Image Generation and Translation.” IEEE/CVF International Conference on Computer Vision (ICCV). https://arxiv.org/abs/2103.16146.

Lee, Dongwook, Junyoung Kim, Won-Jin Moon, and Jong Chul Ye. 2019. “CollaGAN : Collaborative GAN for Missing Image Data Imputation.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://arxiv.org/abs/1901.09764.

Lehtinen, Jaakko, Jacob Munkberg, Jon Hasselgren, et al. 2018. “Noise2Noise: Learning Image Restoration Without Clean Data.” International Conference on Machine Learning (ICML).

Lei, Na, Kehua Su, Li Cui, Shing-Tung Yau, and David Xianfeng Gu. 2017. A Geometric View of Optimal Transportation and Generative Model. https://arxiv.org/abs/1710.05488.

Li, Yijun, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, and Ming-Hsuan Yang. 2017. “Universal Style Transfer via Feature Transforms.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1705.08086.

Lim, Jae Hyun, and Jong Chul Ye. 2017. Geometric GAN. https://arxiv.org/abs/1705.02894.

Mao, Xudong, Qing Li, Haoran Xie, Raymond Y. K. Lau, Zhen Wang, and Stephen Paul Smolley. 2017. “Least Squares Generative Adversarial Networks.” IEEE International Conference on Computer Vision (ICCV). https://arxiv.org/abs/1611.04076.

McCann, Robert J. 1995. “Existence and Uniqueness of Monotone Measure-Preserving Maps.” Duke Mathematical Journal 80 (2): 309–23.

Metz, Luke, Ben Poole, David Pfau, and Jascha Sohl-Dickstein. 2017. “Unrolled Generative Adversarial Networks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1611.02163.

Miyato, Takeru, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida. 2018. “Spectral Normalization for Generative Adversarial Networks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1802.05957.

Moran, Nick, Dan Schmidt, Yu Zhong, and Patrick Coady. 2020. “Noisier2Noise: Learning to Denoise from Unpaired Noisy Data.” IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

Mroueh, Youssef, Tom Sercu, and Vaibhava Goel. 2017. “McGan: Mean and Covariance Feature Matching GAN.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1702.08398.

Nguyen, XuanLong, Martin J. Wainwright, and Michael I. Jordan. 2010. “Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization.” IEEE Transactions on Information Theory 56 (11): 5847–61. https://arxiv.org/abs/0809.0853.

Nichol, Alexander Quinn, and Prafulla Dhariwal. 2021. “Improved Denoising Diffusion Probabilistic Models.” International Conference on Machine Learning (ICML) 139: 8162–71.

Nowozin, Sebastian, Botond Cseke, and Ryota Tomioka. 2016. “F-GAN: Training Generative Neural Samplers Using Variational Divergence Minimization.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1606.00709.

Papamakarios, George, Theo Pavlakou, and Iain Murray. 2017. “Masked Autoregressive Flow for Density Estimation.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1705.07057.

Peyré, Gabriel, and Marco Cuturi. 2019. “Computational Optimal Transport.” Foundations and Trends in Machine Learning 11 (5–6): 355–607. https://arxiv.org/abs/1803.00567.

Radford, Alec, Luke Metz, and Soumith Chintala. 2016. “Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1511.06434.

Ramani, Sathish, Thierry Blu, and Michael Unser. 2008. “Monte-Carlo SURE: A Black-Box Optimization of Regularization Parameters for General Denoising Algorithms.” IEEE Transactions on Image Processing 17 (9): 1540–54.

Rezende, Danilo Jimenez, and Shakir Mohamed. 2015. “Variational Inference with Normalizing Flows.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1505.05770.

Romano, Yaniv, Michael Elad, and Peyman Milanfar. 2017. “The Little Engine That Could: Regularization by Denoising (RED).” SIAM Journal on Imaging Sciences 10 (4): 1804–44.

Saharia, Chitwan, William Chan, Saurabh Saxena, et al. 2022. “Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/2205.11487.

Salimans, Tim, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. “Improved Techniques for Training GANs.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1606.03498.

Salimans, Tim, and Jonathan Ho. 2022. “Progressive Distillation for Fast Sampling of Diffusion Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2202.00512.

Santambrogio, Filippo. 2015. Optimal Transport for Applied Mathematicians. Birkhäuser.

Sim, Byeongsu, Gyutaek Oh, Jeongsol Kim, Chanyong Jung, and Jong Chul Ye. 2020. “Optimal Transport Driven CycleGAN for Unsupervised Learning in Inverse Problems.” SIAM Journal on Imaging Sciences. https://arxiv.org/abs/1909.12116.

Sohl-Dickstein, Jascha, Eric A. Weiss, Niru Maheswaranathan, and Surya Ganguli. 2015. “Deep Unsupervised Learning Using Nonequilibrium Thermodynamics.” International Conference on Machine Learning (ICML) 37: 2256–65.

Soltanayev, Shakarim, and Se Young Chun. 2018. “Training Deep Learning Based Denoisers Without Ground Truth Data.” Advances in Neural Information Processing Systems (NeurIPS).

Song, Jiaming, Chenlin Meng, and Stefano Ermon. 2021. “Denoising Diffusion Implicit Models.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2010.02502.

Song, Yang, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2021. “Score-Based Generative Modeling Through Stochastic Differential Equations.” International Conference on Learning Representations (ICLR). https://arxiv.org/abs/2011.13456.

Sriperumbudur, Bharath K., Kenji Fukumizu, Arthur Gretton, Bernhard Schölkopf, and Gert R. G. Lanckriet. 2009. On Integral Probability Metrics, Phi-Divergences and Binary Classification. https://arxiv.org/abs/0901.2698.

Stein, Charles M. 1981. “Estimation of the Mean of a Multivariate Normal Distribution.” The Annals of Statistics 9 (6): 1135–51.

Ulyanov, Dmitry, Andrea Vedaldi, and Victor Lempitsky. 2016. Instance Normalization: The Missing Ingredient for Fast Stylization. https://arxiv.org/abs/1607.08022.

Vaswani, Ashish, Noam Shazeer, Niki Parmar, et al. 2017. “Attention Is All You Need.” Advances in Neural Information Processing Systems (NeurIPS). https://arxiv.org/abs/1706.03762.

Villani, Cédric. 2003. Topics in Optimal Transportation. Vol. 58. Graduate Studies in Mathematics. American Mathematical Society.

Villani, Cédric. 2009. Optimal Transport: Old and New. Vol. 338. Grundlehren Der Mathematischen Wissenschaften. Springer.

Vincent, Pascal. 2011. “A Connection Between Score Matching and Denoising Autoencoders.” Neural Computation 23 (7): 1661–74.

Wu, Yuxin, and Kaiming He. 2018. “Group Normalization.” European Conference on Computer Vision (ECCV). https://arxiv.org/abs/1803.08494.

Ye, Jong Chul. 2022. Geometry of Deep Learning: A Signal Processing Perspective. Mathematics in Industry. Springer. https://doi.org/10.1007/978-981-16-6046-7.

Ye, Jong Chul. 2026a. AI618 Generative Models and Unsupervised Learning: Lecture Slides. KAIST, Part 1 — GAN.

Ye, Jong Chul. 2026c. AI618 Generative Models and Unsupervised Learning: Lecture Slides. KAIST, Part 2 — VAE.

Ye, Jong Chul. 2026b. AI618 Generative Models and Unsupervised Learning: Lecture Slides. KAIST, Part 3 — Self-supervised Image Denoising.

Ye, Jong Chul. 2026d. AI618 Generative Models and Unsupervised Learning: Lecture Transcript. KAIST, lecture 03.

Ye, Jong Chul. 2026e. AI618: Generative Models and Unsupervised Learning, Part 4: Diffusion Model Theory. Lecture slides, KAIST Graduate School of AI.

Yoon, Jinsung, James Jordon, and Mihaela van der Schaar. 2018. “RadialGAN: Leveraging Multiple Datasets to Improve Target-Specific Predictive Models Using Generative Adversarial Networks.” International Conference on Machine Learning (ICML). https://arxiv.org/abs/1802.06403.

Zhang, Kai, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. 2017. “Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising.” IEEE Transactions on Image Processing 26 (7): 3142–55.

Zhu, Jun-Yan, Taesung Park, Phillip Isola, and Alexei A. Efros. 2017. “Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks.” IEEE International Conference on Computer Vision (ICCV). https://arxiv.org/abs/1703.10593.