|
| 1 | +title: 'Tutorial 7: Deep Energy-Based Generative Models' |
| 2 | +author: Phillip Lippe |
| 3 | +created: 2021-07-12 |
| 4 | +updated: 2023-03-14 |
| 5 | +license: CC BY-SA |
| 6 | +build: 1 |
| 7 | +tags: |
| 8 | +- Image |
| 9 | +description: 'In this tutorial, we will look at energy-based deep learning models, |
| 10 | + and focus on their application as generative models. |
| 11 | +
|
| 12 | + Energy models have been a popular tool before the huge deep learning hype around |
| 13 | + 2012 hit. |
| 14 | +
|
| 15 | + However, in recent years, energy-based models have gained increasing attention because |
| 16 | + of improved training methods and tricks being proposed. |
| 17 | +
|
| 18 | + Although they are still in a research stage, they have shown to outperform strong |
| 19 | + Generative Adversarial Networks |
| 20 | +
|
| 21 | + in certain cases which have been the state of the art of generating images |
| 22 | +
|
| 23 | + ([blog post](https://ajolicoeur.wordpress.com/the-new-contender-to-gans-score-matching-with-langevin-sampling/)about |
| 24 | + strong energy-based models, |
| 25 | +
|
| 26 | + [blog post](https://medium.com/syncedreview/nvidia-open-sources-hyper-realistic-face-generator-stylegan-f346e1a73826) |
| 27 | + about the power of GANs). |
| 28 | +
|
| 29 | + Hence, it is important to be aware of energy-based models, and as the theory can |
| 30 | + be abstract sometimes, |
| 31 | +
|
| 32 | + we will show the idea of energy-based models with a lot of examples. |
| 33 | +
|
| 34 | + This notebook is part of a lecture series on Deep Learning at the University of |
| 35 | + Amsterdam. |
| 36 | +
|
| 37 | + The full list of tutorials can be found at https://uvadlc-notebooks.rtfd.io. |
| 38 | +
|
| 39 | + ' |
| 40 | +requirements: |
| 41 | +- torchvision |
| 42 | +- matplotlib |
| 43 | +- tensorboard |
| 44 | +- pytorch-lightning>=2.0.0 |
| 45 | +accelerator: |
| 46 | +- CPU |
| 47 | +- GPU |
| 48 | +environment: |
| 49 | +- numpy==1.26.4 |
| 50 | +- setuptools==69.0.3 |
| 51 | +- ipython==8.16.1 |
| 52 | +- pytorch-lightning==2.0.9.post0 |
| 53 | +- torchmetrics==1.2.1 |
| 54 | +- torchvision==0.15.2 |
| 55 | +- tensorboard==2.17.0 |
| 56 | +- urllib3==2.2.2 |
| 57 | +- torch==2.0.1 |
| 58 | +- matplotlib==3.8.4 |
| 59 | +published: '2024-07-19T19:46:41.289373' |
0 commit comments