Can we add this? https://github.com/haoheliu/AudioLDM

[vdruts]

Check this out, would be awesome https://github.com/haoheliu/AudioLDM

[vladmandic]

it does look cool, but how is that related to txt2img, seems like a completely separate project.

[ke1ne]

It seems it can be implemented as extension with a separate tab. It has ckpts and code example on Huggingface.

[vdruts]

Well it's text to (sound) which can easily augment creative projects done with text-image/video , especially with all of the plugins for auto that do that (Sadtalker) etc

[ke1ne]

If you have proper skills, implement it as an extension with a separate tab, like Deforum, etc. I think it could be a good compromise, instead of a core integration or something.

[ke1ne]

@bbecausereasonss Maybe, I did lost something, but where are checkpoint files to use with their code?
UPD. Nevermind, found them https://huggingface.co/spaces/haoheliu/audioldm-text-to-audio-generation/tree/main