training sd with dreambooth/textual inversion with two different class of images

Describe the bug

Hi,

I am following stable diffusion training with the dreambooth example at local machine. Although the following link gives every details about training sd, however I am unable to identify utilizing this example when I have two or more different classes of images.: https://github.com/huggingface/diffusers/tree/main/examples/dreambooth#training-on-a-16gb-gpu

For example, Instead of using only dog toy example, the user also want to include cat toy example for single training script.

Reproduction

No response

Logs

No response

System Info

• diffusers version: 0.9.0
• Platform: Linux-5.10.133±x86_64-with-Ubuntu-18.04-bionic
• Python version: 3.7.15
• PyTorch version (GPU?): 1.12.1+cu113 (True)
• Huggingface_hub version: 0.11.1
• Transformers version: 4.24.0
• Using GPU in script?: (True)
• Using distributed or parallel set-up in script?: No

[hamzafar]

Thanks for sharing update @williamberman. It would wonderful if the script also takes multiple prompts(list).

[williamberman]

We have a script that potentially can manage multiple subjects. We’ll see how good the results are before updating the existing script in the repo but don’t have an exact timeline when will have that tested! Thank you for bearing with us @hamzafar 😃