Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create live, updating data workflow for RVFcast data #16

Closed
4 tasks
noamross opened this issue Mar 13, 2023 · 1 comment
Closed
4 tasks

Create live, updating data workflow for RVFcast data #16

noamross opened this issue Mar 13, 2023 · 1 comment
Assignees
@noamross
Labels
automations
Milestone
Infrastructure an...

Comments

@noamross
Copy link
Contributor

  • Use existing data functions to pull daily/weekly data into processed, but not merged form csv/parquets in temp directory
  • Have merged form be a downstream target
  • Do repacking as necessary
  • Figure out the right caching workflow in targets
@noamross noamross self-assigned this Mar 13, 2023
@noamross noamross changed the title Live data workflow Create live, updating data workflow for RVFcast data Mar 20, 2023
@emmamendelsohn emmamendelsohn added this to the Data ingest pipeline milestone Aug 4, 2023
@emmamendelsohn emmamendelsohn mentioned this issue Jun 28, 2024
Closed
21 tasks
@emmamendelsohn emmamendelsohn mentioned this issue Jun 28, 2024
Open
@emmamendelsohn
Copy link
Collaborator

Closed to address in #93

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@noamross noamross

Labels
automations
Projects
None yet
Milestone
Infrastructure and integration with A...
Development

No branches or pull requests
2 participants
@noamross @emmamendelsohn