[Feature Request] Split conditioning for lower VRAM usage + better performance

[TheEnhas]

Mentioned here: basujindal/stable-diffusion#168

Edit: This is not split attention but something different, if this is already in the UI then I didn't know beforehand

[JustAnOkapi]

Edit: This is not split attention but something different, if this is already in the UI then I didn't know beforehand

stable-diffusion-webui/modules/sd_samplers.py

Line 85 in 7fe00d0

def p_sample_ddim_hook(self, x_dec, cond, ts, unconditional_conditioning, *args, **kwargs):

already implemented

[JustAnOkapi]

it was added 10 hours ago so check if you need to pull
f2693be

[JustAnOkapi]

Mentioned here: basujindal/stable-diffusion#168

Edit: This is not split attention but something different, if this is already in the UI then I didn't know beforehand

Also is not better performance, approximately half vram usage but 40% slower.

[TheEnhas]

Yeah, for some reason I was reading the inference time backwards and thought more = better, also never noticed that commit so thanks