Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

helper + github actions for QA? #11

Open
yarikoptic opened this issue Oct 22, 2020 · 1 comment
Open

helper + github actions for QA? #11

yarikoptic opened this issue Oct 22, 2020 · 1 comment

Comments

@yarikoptic
Copy link
Member

on push and cron those could at least verify that every annexed file is still available from our S3

I think we need to establish some helper to given a dandiset execute necessary tests + create a github action so that backups2datalad.py then should instantiate workflows invoking that action which "installs" all necessary for helper dependencies and runs the tests and reports on success/failure.

@yarikoptic
Copy link
Member Author

the easiest way to check that URLs are still valid would be

git annex fsck -f web --fast -J10

but it puts strain on our dandi-api since api URL is considered first by git-annex before the direct S3 URL, so we might want to wait for being able to assign costs to urls: filed https://git-annex.branchable.com/todo/assign_costs_per_URL_or_better_repo-wide___40__regexes__41__/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant