Stable Diffusion — ControlNet Clearly Explained!
Generating images from line art, scribble, or pose key points using Stable Diffusion and ControlNet.
ControlNet is a neural network that controls a pretrained image Diffusion model (e.g. Stable Diffusion). Its function is to allow input of a conditioning image, which can then be used to manipulate the image generation.
Table of Contents
├─ What Does ControlNet Do?
├─ Inner Architecture
│ ├─ Feedforward
│ ├─ Backpropagation
├─ Architecture with Stable Diffusion
│ ├─ Encoder
│ ├─ Overall Architecture
├─ Training
├─ Conditioning
│ ├─ Canny Edge
│ ├─ Line Art
│ ├─ Scribble
│ ├─ Hough Line
│ ├─ Semantic Segmentation
│ ├─ Depth
│ ├─ Normal Map
│ ├─ Open Pose
├─ Summary
├─ References
