Skip to content

An system for storing LoRA Checkpoints so that you can incrementally finetune on a variety of tasks. Intended to help with a specific experiment I am working on but there are other use cases. The main benefit is a lesser storage cost compared to saving the full weights of the model but without the restricted dimensionality of a single LoRA.

Notifications You must be signed in to change notification settings

mikeybellissimo/Lora-Chain

Repository files navigation

Lora-Chain

About

An system for storing LoRA Checkpoints so that you can incrementally finetune on a variety of tasks. Intended to help with a specific experiment I am working on but there are other use cases. The main benefit is a lesser storage cost compared to saving the full weights of the model but without the restricted dimensionality of a single LoRA.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages