fast-stable-diffusion is not utilizing xformers

We have found out that fast-stable-diffusion is not utilizing xformers, and is in fact slower than the default colab for Automatic1111’s webui.

Base webui runs at around 5 it/s on a T4 w/o xformers (likely due to newer versions of dependencies)

Base fast-stable-diffusion runs around 0.5it/s slower than default on a T4

Fixed xformers implementation runs at 6.5 it/s on a T4

This is a simple fix, update the xformer wheels to 0.14 and add the --xformers launch option.

You can test this out using our fork’s T4 wheel if you’d like, keep in mind this only fixes the issue for T4s.

The actual wheel is xformers-0.0.14.dev0-cp37-cp37m-linux_x86_64.whl which we built ourselves on a T4.

[Maw-Fox]

Do note; xformers 0.0.13 does not work with the --xformers flag, it will error upon attempting the forward/step function during inference.

[rektobot]

been having the same issue and i re-installed xformers the other day. cant run T4 without cuda errors and premium only gives me 2.5-2.7s/it. put command line args at --force-enable-xformers --no-half-vae and also --xformers just to be sure. but im using ‘export’ command and not ‘set’ after uncommenting the commands. surprised everything didnt melt down. i have no idea what im doing, just over here typing shit hoping i dont randomly explode