I decided to see what CLIP+VQGAN would do when I gave it a house and told it to make it haunted.

Original image:
https://commons.wikimedia.org/wiki/File:25Sep2018_Bedford_Gates_Handyside_Victorian_House.jpg
vs modified to better match the phrase "a haunted Victorian house"