Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect run gets started #40274

Open
2 tasks done
CarlKarlssonSchmidt opened this issue Jun 17, 2024 · 2 comments
Open
2 tasks done

Incorrect run gets started #40274

CarlKarlssonSchmidt opened this issue Jun 17, 2024 · 2 comments
Labels
area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet pending-response

Comments

@CarlKarlssonSchmidt
Copy link

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

2.6.3

What happened?

We have seen that on DAG:s with depend_on_past=True & max_active_task=1 a run which is not the next in line starts and immediately hangs due to depend_on_task=True. Since we have max_active_task=1 this blocks the DAG from running completely until the incorrect run i cleared manually.

Screenshot from 2024-06-14 07-53-01
Screenshot from 2024-06-17 11-13-40

What you think should happen instead?

The next run in line should be started

How to reproduce

This is intermittent. I'm running a re-running a DAG by clearing the state on all previous runs. Maybe 1 of 10 triggeres are on the wrong date.

Operating System

MWAA

Versions of Apache Airflow Providers

No response

Deployment

Amazon (AWS) MWAA

Deployment details

No response

Anything else?

For this DAG and a dag with a sensor to it, 1 out of 10 triggers/runs are incorrect.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@CarlKarlssonSchmidt CarlKarlssonSchmidt added area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet labels Jun 17, 2024
Copy link

boring-cyborg bot commented Jun 17, 2024

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

@vatsrahul1001
Copy link
Collaborator

@CarlKarlssonSchmidt I am not able to reproduce this. can you share your DAG? Also have you also tested this with 2.9.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:core kind:bug This is a clearly a bug needs-triage label for new issues that we didn't triage yet pending-response
Projects
None yet
Development

No branches or pull requests

2 participants