Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[Community Pipeline] Imagic: Text-Based Real Image Editing with Diffusion Models

See original GitHub issue

Intro

Community Pipelines are introduced in diffusers==0.4.0 with the idea of allowing the community to quickly add, integrate, and share their custom pipelines on top of diffusers.

You can find a guide about Community Pipelines here. You can also find all the community examples under examples/community/. If you have questions about the Community Pipelines feature, please head to the parent issue.

Idea: Imagic: Text-based Real Image Editing with Diffusion Models

This pipeline aims to implement this paper to Stable Diffusion, allowing for real-world image editing. Example from the paper:

Issue Analytics

State:
Created a year ago
Comments:9 (4 by maintainers)

Top GitHub Comments

7reactions

asofiaoliveiracommented, Oct 18, 2022

I would like to work on this

5reactions

Alx-AIcommented, Oct 18, 2022

Would love to see this added, notebook implementation here for reference https://github.com/justinpinkney/stable-diffusion/blob/main/notebooks/imagic.ipynb

Top Results From Across the Web

Text-Based Real Image Editing with Diffusion Models - arXiv

Our method, which we call "Imagic", leverages a pre-trained text-to-image diffusion model for this task. It produces a text embedding that ...

AK on Twitter: "Imagic: Text-Based Real Image Editing with ...

Imagic : Text-Based Real Image Editing with Diffusion Models abs: ... being able to move in the latent space to accomplish editing tasks...

AI Image Editing from Text using Diffusion Models ... - YouTube

Imagic : Text - Based Real Image Editing with Diffusion Models. arXiv preprint https://arxiv.org/abs/2210.09276. ▻ Use it with Stable ...

Exemplar-based Image Editing with Diffusion Models

The whole framework involves a single forward of the diffusion model without any iterative optimization. We demonstrate that our method achieves ...

Multimodal Image Synthesis and Editing: A Survey - OSF

real image editing, without requiring ad-hoc supervision ... diffusion models in high-fidelity image synthesis, the text- ... Overall, the pipeline for.