Skip to content

parallel data loading on s3 #3

@anhhuyalex

Description

@anhhuyalex
  • download all of openneuro onto s3 fmri func niftis
  • process: download from s3, do all the transforms, write to wds, and then upload back into s3
  • don't go above 500 gb for /weka

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions