Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

VQ-Diffusion

See original GitHub issue

Model/Pipeline/Scheduler description

VQ-Diffusion is based on a VQ-VAE whose latent space is modeled by a conditional variant of the recently developed Denoising Diffusion Probabilistic Model (DDPM). It produces significantly better text-to-image generation results when compared with Autoregressive models with similar numbers of parameters. Compared with previous GAN-based methods, VQ-Diffusion can handle more complex scenes and improve the synthesized image quality by a large margin.

https://github.com/microsoft/VQ-Diffusion

Open source status

The model implementation is available
The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

VQ-Diffusion would be a super cool addition to diffusers. cc @cientgu and @zzctan .

Also cc @patil-suraj here

Issue Analytics

State:
Created a year ago
Reactions:3
Comments:17 (11 by maintainers)

Top GitHub Comments

3reactions

345ishaancommented, Sep 28, 2022

SG! I will check your CL. Do you want to chat over discord?

2reactions

unographycommented, Sep 6, 2022

Hi @patrickvonplaten, would love to take this up!

Top Results From Across the Web

Official implementation of VQ-Diffusion - GitHub

VQ -Diffusion is based on a VQ-VAE whose latent space is modeled by a conditional variant of the recently developed Denoising Diffusion Probabilistic...

Vector Quantized Diffusion Model for Text-to-Image Synthesis

Abstract: We present the vector quantized diffusion (VQ-Diffusion) model for text-to-image generation. This method is based on a vector ...

cjwbw/vq-diffusion – Run with an API on Replicate

VQ -Diffusion is based on a VQ-VAE whose latent space is modeled by a conditional variant of the recently developed Denoising Diffusion Probabilistic...

Vector Quantized Diffusion Model for Text ... - CVF Open Access

We present the vector quantized diffusion (VQ-. Diffusion) model for text-to-image generation, a model that eliminates the unidirectional bias and avoids accu-.

VQ-Diffusion - Hugging Face

Vector Quantized Diffusion (VQ-Diffusion) is a conditional latent diffusion model developed by the University of Science and Technology of ...