Deep Generative Modeling

is first comprehensive book on models behind Generative AI has been thoroughly revised to cover all major classes of deep generative models: mixture models, Probabilistic Circuits, Autoregressive Models, Flow-based Models, Latent Variable Models, GANs, Hybrid Models, Score-based Generative Models, Energy-based Models, and Large Language Models. In addition, Generative AI Systems are discussed, demonstrating how deep generative models can be used for neural compression, among others.

Deep Generative Modeling is designed to appeal to curious students, engineers, and researchers with a modest mathematical background in undergraduate calculus, linear algebra, probability theory, and the basics of machine learning, deep learning, and programming in Python and PyTorch (or other deep learning libraries). It should find interest among students and researchers from a variety of backgrounds, including computer science, engineering, data science, physics, and bioinformatics who wish to get familiar with deep generative modeling.

In order to engage with a reader, the book introduces fundamental concepts with specific examples and code snippets. The full code accompanying the book is available on the author’s GitHub site: github.com/jmtomczak/intro_dgm

The ultimate aim of the book is to outline the most important techniques in deep generative modeling and, eventually, enable readers to formulate new models and implement them.

Table of Contents

1 Why Deep Generative Modeling?

2 Probabilistic Modeling: From Mixture Models to Probabilistic Circuits

3 Autoregressive Models

4 Flow-Based Models

5 Latent Variable Models

6 Hybrid Modeling

7 Energy-Based Models

8 Generative Adversarial Networks

9 Score-Based Generative Models

10 Deep Generative Modeling for Neural Compression

11 From Large Language Models to Generative Al Systems

Useful Facts from Algebra and Calculus

Useful Facts from Probability Theory and Statistics

About the Author

Jakub M. Tomczak  is an associate professor and the head of the Generative AI group at the Eindhoven University of Technology (TU/e). Before joining the TU/e, he was an assistant professor at Vrije Universiteit Amsterdam, a deep learning researcher (Engineer, Staff) in Qualcomm AI Research in Amsterdam, a Marie Sklodowska-Curie individual fellow in Prof. Max Welling’s group at the University of Amsterdam, and an assistant professor and a postdoc at the Wroclaw University of Technology. His main research interests include ML, DL, deep generative modeling (GenAI), and Bayesian inference, with applications to image/text processing, Life Sciences, Molecular Sciences, and quantitative finance. He serves as an action editor of “Transactions of Machine Learning Research”, and an area chair of major AI conferences (e.g., NeurIPS, ICML, AISTATS). He is a program chair of NeurIPS 2024. He is the author of the book entitled “Deep Generative Modeling”, the first comprehensive book on Generative AI. He is also the founder of Amsterdam AI Solutions.