Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run geospatial benchmarks using on-demand clusters #1606

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

hendrikmakait
Copy link
Member

Spot replacement severely skews benchmark results, and we currently don't have the ability to detect replacement and exclude affected results or restart benchmarks (#1241).

cc @fjetter: This may have a significant impact on cost.

@hendrikmakait
Copy link
Member Author

hendrikmakait commented Nov 15, 2024

FWIW, when analyzing clusters I haven't really seen spot instances being used anyways. YMMV.

@ntabris
Copy link
Member

ntabris commented Nov 15, 2024

FWIW, when analyzing clusters I haven't really seen spot instances being used anyways. YMMV.

Is this AWS? GCP?

@hendrikmakait
Copy link
Member Author

Most run on GCP, one on Azure, one on AWS.

@ntabris
Copy link
Member

ntabris commented Nov 15, 2024

Most run on GCP

We might not have quota for spot (aka preemptible) in the relevant account or region. Let me know if you'd like to use spot... but it sounds like maybe you don't want to use spot anyway.

@hendrikmakait
Copy link
Member Author

We might not have quota for spot (aka preemptible) in the relevant account or region. Let me know if you'd like to use spot... but it sounds like maybe you don't want to use spot anyway.

I'll defer to @fjetter on that since I'll be out on PTO next week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants