GPU directories not being created correctly

Hello,

I’m attempting to run dream-factory on a ubuntu machine, it appears to be running - the web interface comes up and all GPUs show status dreaming, however after some time the following errors start to get thrown. It appears to be something wrong with the folder creation.

After a bit more time only two of the devices (which seem to be random), continue running. The other devices get stuck in the following +exif data state. While two of the devices keep dreaming and generating files. The files however are not stored/copied into the proper directories e.g. gpu_0, they remain in the root of the output/<date-config_name> directory.

I will attempt to debug this and make changes, however if you have any idea or guidance what could cause this that would be helpful. I really like this project and would like to contribute.

Please see the error below, following screenshot and system info.

Exception in thread Thread-17:
Traceback (most recent call last):
  File "/home/lol/anaconda3/envs/dream-factory/lib/python3.9/threading.py", line 980, in _bootstrap_inner
    self.run()
  File "/home/lol/dream-factory/dream-factory.py", line 143, in run
    new_files = os.listdir(samples_dir)
FileNotFoundError: [Errno 2] No such file or directory: 'output/2022-11-28-example-standard/gpu_4'
Exception in thread Thread-15:
Traceback (most recent call last):
  File "/home/lol/anaconda3/envs/dream-factory/lib/python3.9/threading.py", line 980, in _bootstrap_inner
    self.run()
  File "/home/lol/dream-factory/dream-factory.py", line 143, in run
    new_files = os.listdir(samples_dir)
FileNotFoundError: [Errno 2] No such file or directory: 'output/2022-11-28-example-standard/gpu_2'

Below are the system specs

(dream-factory) lol@lol-H110-D3A:~/dream-factory$ lsb_release -a

...

Distributor ID:	Ubuntu
Description:	Ubuntu 22.04.1 LTS
Release:	22.04
Codename:	jammy

(dream-factory) lol@lol-H110-D3A:~/dream-factory$ sudo lshw -short

...

H/W path           Device     Class          Description
========================================================
                              system         H110-D3A (Default string)
/0                            bus            H110-D3A-CF
/0/0                          memory         64KiB BIOS
/0/3d                         memory         20GiB System Memory
/0/3d/0                       memory         16GiB DIMM DDR4 Synchronous 2133 MH
/0/3d/1                       memory         [empty]
/0/3d/2                       memory         4GiB DIMM DDR4 Synchronous 2133 MHz
/0/3d/3                       memory         [empty]
/0/43                         memory         128KiB L1 cache
/0/44                         memory         512KiB L2 cache
/0/45                         memory         2MiB L3 cache
/0/46                         processor      Intel(R) Celeron(R) CPU G3930 @ 2.9
/0/100                        bridge         Xeon E3-1200 v6/7th Gen Core Proces
/0/100/1                      bridge         6th-10th Gen Core Processor PCIe Co

CUDA devices

(dream-factory) lol@lol-H110-D3A:~/dream-factory$ nvidia-smi

Mon Nov 28 15:32:21 2022       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 520.61.05    Driver Version: 520.61.05    CUDA Version: 11.8     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
|  0%   46C    P0    35W / 180W |    386MiB /  8192MiB |      5%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA GeForce ...  Off  | 00000000:03:00.0 Off |                  N/A |
|  0%   49C    P8    24W / 220W |      6MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA GeForce ...  Off  | 00000000:04:00.0 Off |                  N/A |
|  0%   35C    P8     6W / 180W |      6MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA GeForce ...  Off  | 00000000:05:00.0 Off |                  N/A |
|  0%   37C    P8     7W / 180W |      6MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   4  NVIDIA GeForce ...  Off  | 00000000:06:00.0 Off |                  N/A |
|  0%   49C    P8    23W / 240W |      6MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   5  NVIDIA GeForce ...  Off  | 00000000:07:00.0 Off |                  N/A |
|  0%   45C    P8    17W / 240W |      6MiB /  8192MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

[rbbrdckybk]

Just pushed the latest code up - I’m pretty confident that everything will work for you, though I do recommend a fresh install. Full changelog is here. You’ll also need to set up Auto1111’s repo as part of the setup process now; although that should take more than a few minutes.

Let me know how it goes for you!

[rbbrdckybk]

@mkabatek oh my bad, img2img is already implemented! Just create a new prompt file and take a look at these 2 settings:

!INPUT_IMAGE = 		# can specify an input image here (output image will be same resolution)
!STRENGTH = 0.75	# strength of input image influence (0-1, with 1 corresponding to least influence)

Just set !INPUT_IMAGE= to whatever image you want to use at the starting image (relative to the Dream Factory folder, or absolute paths are fine too). !STRENGTH is the denoising strength. In standard prompt files, you can put both of these in the [prompts] sections too, in case you want to set up switches between multiple input images. Setting !INPUT_IMAGE= by itself will clear out any set input image.

I really need to get some documentation on the github page. 🤣