Using ChatGPT to create prompts for Stable Diffusion

FeglioGative
2 min readJan 1, 2023

--

© Image by author

ChatGPT has brought the power of language models for dialogue to the masses. You’ll find lots of use cases, and also its flaws, all over the internet.

But can you use ChatGPT to create unique prompts for Stable Diffusion?

The quick answer is “yes”

It all starts with what you ask from ChatGPT. The image above was generated from the prompt ”Time-traveling robot gardens”.

But how did ChatGPT came up with such a strange prompt? Simply by asking it to “Create surreal phrases with 3 words

ChatGPT returned the following:

  1. “Electric jellyfish circus”
  2. “Galactic unicorn manifestation”
  3. “Hypnotic mushroom playground”
  4. “Neon dragon dreamscape”
  5. “Psychic octopus meditation”
  6. “Time-traveling robot gardens”
  7. “Flaming phoenix constellation”
  8. “Invisible elephant orchestra”
  9. “Rainbow-colored dinosaur parade”
  10. “Serene mermaid waterfall”

Depending on the model you are using, the results will differ for these prompts, of course.

© Images by author

The results above were obtained by using Diffusion Bee with the dream like art model

Conclusions

As explained you can use ChatGPT to come up with simple, or complex prompts, and then feed them into Stable Diffusion and get amazing results. Not all of them will be amazing, of course. In the prompts I used we go from the really detailed to results that fail to capture the prompt. One more reason to keep exploring.

--

--