Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reformat dataset configs, add missing collections #86

Merged
merged 5 commits into from
Nov 1, 2023

Conversation

smohiudd
Copy link
Contributor

@smohiudd smohiudd commented Oct 25, 2023

The PR includes:

  • new dataset-config directory which includes the json config that can be used with the dataset/publish API endpoint. The list of collections is incomplete.
  • recreation of all collections jsons from the staging STAC api. This updates old collection metadata and reconciles veda-data with the staging STAC api so there are no missing collections files.

@anayeaye
Copy link
Contributor

anayeaye commented Oct 31, 2023

A couple related operations comments (not necessarily for this PR):

If we want to publish these directly for our staging stack, my only concert about this is making sure we don't wipe out the collection summaries. Is that something you could carry over if it existed with the reformat.py script? It might also be nice to keep that in git as a support script for future efforts.

And/or we could make a support script to load the collection and call the update dashboard summaries function for all of these except the externally hosted vector collections. EDIT: here's the method to call the summaries and extents updates.

@smohiudd smohiudd merged commit f207bf2 into main Nov 1, 2023
2 checks passed
@j08lue j08lue deleted the reformat-dataset-configs branch December 4, 2023 11:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants