Add skill: migrating-dagster-to-airflow#243
Merged
Merged
Conversation
A skill for migrating Dagster projects to Apache Airflow 3 on Astro: concept map, deep-dive references, six-gate validation ladder, and stdlib helper scripts with a self-contained pytest suite (wired into CI). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GGYcYRpwF7vMhgSSG7v3F8
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GGYcYRpwF7vMhgSSG7v3F8
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
A skill for migrating Dagster projects to Apache Airflow 3 on Astro. It includes:
How it's been tested
Seven full migrations before this PR: Dagster's OSS examples, two community projects (253 and 296 definitions), Dagster Labs' own open-source data platform, a synthetic project that uses every Dagster feature, and one run against a real production Snowflake. Wherever a project could actually run, the migrated pipelines produced the same output data as the original, checked table by table (93/93, 16/16, 13/13, 5/5), and we rehearsed a live cutover and rollback. The docs were also checked against the official Airflow, Dagster, and Cosmos documentation and put through three review passes; the troubleshooting file lists 18 real failures we hit along the way and how to fix each one.
Fit with this repo
migrating-airflow-2-to-3), with the same style of edit hook, easy to drop if you'd rather not have itscripts/follows theanalyzing-datapattern; the CI job added here is the only change outside the skill folder🤖 Generated with Claude Code
https://claude.ai/code/session_01GGYcYRpwF7vMhgSSG7v3F8