Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LoRA support #10

Open
alex-aparin opened this issue Jun 16, 2023 · 5 comments
Open

LoRA support #10

alex-aparin opened this issue Jun 16, 2023 · 5 comments

Comments

@alex-aparin
Copy link

alex-aparin commented Jun 16, 2023

Is there any way to use LoRA models with the library? Should be they converted like main models?

@axodox
Copy link
Owner

axodox commented Jun 16, 2023

This guide from Microsoft suggests that it could work, but I did not try it: https://github.com/microsoft/Olive/tree/main/examples/directml/stable_diffusion

@alex-aparin
Copy link
Author

Thank you. This experiment will be my next step.

@arturodrt
Copy link

Hello Alex, did it work? I would be also interested in using LoRA models

@axodox
Copy link
Owner

axodox commented Jul 22, 2023

As far as I know there is a limitation that ONNX converted LORA-s weights would be "burned into" the original model, as such it would consume a lot of HDD space to use them. However I have heard that the ONNX converter will eventually provide features which make loading safetensors directly feasible.

@alex-aparin
Copy link
Author

@Artuurodrt Hello. I am sorry for late response. Unfortunately I stopped my research. Still have no idea whether it's possible or not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants