feat: add IA3 prompt tuning#2

Draft

maw501 wants to merge 9 commits intomainfrom

add-ia3-prompt-tuning

Commits on Mar 21, 2023

feat: update submodule
Mark Worrall
committed
feat: add no weight decay parameters
Mark Worrall
committed
feat: add flag for checkpointing
Mark Worrall
committed

Commits on Mar 23, 2023

feat: rename ia3_prompt_tuning -> ia3_tuning
Mark Worrall
committed
feat: remove stride parameter
Mark Worrall
committed
feat: add comments to ia3 rescaling function
Mark Worrall
committed
feat: move IA3 scaling after MLP non-linearity
Mark Worrall
committed
feat: update defaults
Mark Worrall
committed
feat: update comment
Mark Worrall
committed