Skip to content

[QUESTION] Will the data get re-shuffled if the sequence length is modified during training? #1002

Description

@SefaZeng

Your question
If I change the seq-length during training, like 4096 -> 8192, or 4096 -> 1024, will the data loader reset the order of the dataset or continue with the old order?
I want to change the seq-length after training maybe 100k steps, and I need the model to continue train with the left data, will Megatron-LM do this by default?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions