-
Notifications
You must be signed in to change notification settings - Fork 49
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: support str in target_modules for LoraConfig (#39)
* build: set dependency to peft>=0.8.0 which enables --target_modules=all-linear Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com> * feat: support str for --target_modules (includes support for --target_modules="all-linear") Supports setting LoraConfig(target_modules=None) when using the train() method programmatically Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com> * fix: target_modules must be a List[] for HfArgumentParser to parse more than 1 command line value For more information see https://github.com/huggingface/transformers/blob/2749e479f30ab13235b0b9b4a6bbcf4c3b29a081/src/transformers/hf_argparser.py#L206-L208 Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com> * refactor: move LoraConfig pre-processing from main() into get_hf_peft_config() Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com> * docs: update docstring of target_modules to reflect new code Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com> --------- Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com>
- v2.6.0
- v2.6.0-rc.1
- v2.5.0
- v2.4.0
- v2.4.0-rc.2
- v2.4.0-rc.1
- v2.3.1
- v2.3.0
- v2.3.0-rc.1
- v2.2.1
- v2.2.0
- v2.2.0-rc.1
- v2.1.2
- v2.1.2-rc.1
- v2.1.1
- v2.1.1-rc.2
- v2.1.1-rc.1
- v2.1.0
- v2.1.0-rc.1
- v2.0.1
- v2.0.0
- v2.0.0-rc.2
- v2.0.0-rc.1
- v1.2.2
- v1.2.1
- v1.2.1-rc.1
- v1.2.0
- v1.2.0-rc.1
- v1.1.0
- v1.1.0-rc.1
- v1.0.0
- v1.0.0-rc.1
- v0.4.0
- v0.4.0-rc.3
- v0.4.0-rc.2
- v0.4.0-rc.1
- v0.3.0
- v0.3.0-rc.1
- v0.2.0
- v0.2.0-rc.1
- v0.1.0
- v0.1.0-rc.1
- v0.0.2rc2
- v0.0.2rc1
1 parent
905248c
commit 5b895c4
Showing
4 changed files
with
11 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -8,7 +8,7 @@ tokenizers>=0.13.3 | |
tqdm | ||
trl | ||
ninja | ||
peft | ||
peft>=0.8.0 | ||
datasets>=2.15.0 | ||
flash-attn | ||
fire |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters