Sample results, Tooling on top of big-sleep

big-sleep is GORGEOUS. We need to explore what it can do, where it shines, and what to avoid.

Adding a few pics down below, but I’m still in early experimentation - will update the thread later.

Puppies

« a colorful cartoon of a dog »

• seed=553905700049900, iteration=160, lr=.07, size=256
• same, iteration=490

« a colorful cartoon of a dog with blue eyes and a heart »

• seed=555169003382600, iteration=400, lr=.07, size=256

Clouds

« clouds in the shape of a donut »

• seed=581307748222100, iteration=360, lr=.07, size=256
• seed=583134047383400, iteration=390, lr=.07, size=256

This post will be edited to add new samples

[enricoros]

@lucidrains I’m experimenting with a UI for human-in-the-loop (@TheodoreGalanos).

Example of a few-hours of coding. Not connected with a backend. I want to have the backend remote, so I can run it on a headless Linux box with a more powerful GPU while viewing the results from my less powerful machine.

Would you be open to a few API changes to enable this sort of operation? mainly updating (some) hyper params, saving/restoring latent state, and getting the png buffer instead of saving it to disk.

[TheodoreGalanos]

Love the artistic direction of this thread. My interest (other than reading the answer to @htoyryla’s question), is in the tooling on top of this beautiful technology that can allow for artistic control, save/restore/collaboration, and to not waste computing resources (and precious time!) running notebook for hours for a single image which is then discarded.

I’m summarizing my ideas for the transition in the “usability” of generative technologies in this picture:

What I’m not mentioning here is the plan for “the day after”, which could use trained networks to replace the manual selection process, and weed out automatically pictures that are straight out garbage (we see many 😃.

This would require API changes to make the library more controllable, executable in a step-by-step fashion, make latent space restorable/saveable (instead of starting from an initial seed and crossing fingers), not to mention then going into editing of the latent space from an UI (point, interpolate, etc). Am I going too far off the deep end? 😃

this is a very important discussion and right at the heart of my research. There are ofc many, many issues to be solved yet but the last couple of months even huge steps towards generative design workflows have been made.

I try to stay a bit sober however because as opposed to many wonderful users of these new workflows I’m not an artist. I’m an engineer and a designer so operationalizing this things under constraints of real world projects is a huge task. Thankfully, that is another area I feel has had some very important works come out in the last few months.

Such an exciting few years we’re entering!