Skip to content

Add dataloaders for handling dataset for torch modules #5

Description

@ankitpatnala

There are two dataloading type defined.
-> Use map based dataset (seemed effective for parallelizing)
-> Use iterable dataset (seemed effective with single node) (Further can be looked upon to update to multi-node multi-gpu setting)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions