Skip to content

Add option to save only trainable (non-frozen) model state in CheckpointManager.save_model_checkpoint + fix syntax error #127

Description

@guillaume-byte

Description:
When fine-tuning only the head (most of the base model frozen), saving full checkpoints wastes a lot of disk space.
We should allow saving:

  • the full model state (current behavior)
  • only the non-frozen/trainable parameters (plus relevant buffers if needed), so head-only finetunes don’t store huge frozen backbones like openVLA 7B parameters.

Place to work:
weightslab/components/checkpoint_manager@save_model_checkpoint

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions