Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Actually get all DAGs running on an accurate schedule #346

Open
jrlegrand opened this issue Jan 15, 2025 · 0 comments
Open

Actually get all DAGs running on an accurate schedule #346

jrlegrand opened this issue Jan 15, 2025 · 0 comments

Comments

@jrlegrand
Copy link
Member

Problem Statement

Should have been done a LONNNNG time ago, but now becoming annoying that I have to trigger Airflow DAGs needed to create marts. This might be a precursor to a change in how we trigger dbt mart build - meaning if all normal E-L Airflow DAGs are running on an accurate schedule, we could just have one dag that runs weekly to trigger all marts - or perhaps we could have marts tagged as "weekly" and "monthly" and the dbt DAG could handle both of those.

Criteria for Success

Automated mart generation.

Additional Information

For my crappy dev laptop to work, this is dependent on #345

@jrlegrand jrlegrand added this to the Automate all the things milestone Jan 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant