Skip to content

add merge_lora.py#548

Open
Nsigma-Bill wants to merge 1 commit into
tloen:mainfrom
Nsigma-Bill:main
Open

add merge_lora.py#548
Nsigma-Bill wants to merge 1 commit into
tloen:mainfrom
Nsigma-Bill:main

Conversation

@Nsigma-Bill

@Nsigma-Bill Nsigma-Bill commented Jul 19, 2023

Copy link
Copy Markdown

This PR:

  1. Add a new script named merge_lora.py
  2. Update and simplify the previous LoRA merging process (perform merging operation under the new huggingface peft framework and remove unnecessary operations in export_*_checkpoint.py).
  3. Make the codes more straightforward and easier to read.
  4. The resulting merged standalone model bin files could be directly used for llama.cpp conversion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant