Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Retry on timeout when building macOS bins #1178

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

DeeDeeG
Copy link
Member

@DeeDeeG DeeDeeG commented Dec 30, 2024

CI: Retry on timeout when building macOS bins

Also, adjust the timeout duration to be shorter, and adjust the number of retries to be greater.

I figure successful runs usually succeed quickly (~27 minutes or less?). So, get to the retrying faster! But also, let's actually retry, a bunch more times if we have to!

[Testing testing, this is a draft to put CI through it's paces, to try and see if this is the right approach. Should be run at busy times of day, such as toward the end of a typical working day in the Americas time zones.]

Also, adjust the timeout duration to be shorter,
and adjust the number of retries to be greater.

I figure successful runs usually succeed quickly (~27 minutes or less?)
So, get to the retrying faster! But also, let's actually retry,
a bunch more times if we have to!
37 minutes is a bit long. 31 minutes should allow most runs that are
*going* to finish to finish, without wasting more time than we need to
waiting for runs that are hung and are never going to finish anyway.

Considered 27, since *most* runs finish at 16 minutes, and all but one
of my ~11 test runs were under 27 minutes, but *one* of my test runs was
just under 31 minutes, so this should do the trick.

Having to wait for an entire additional run by being over-eager to retry
(too impatient) feels wasteful and not the best trade-off.

Anyhow, this is closer to the right number, even if picking a better
"exact ideal timeout" may be possible, this is close enough.
@DeeDeeG DeeDeeG marked this pull request as ready for review January 7, 2025 02:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant