Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add landsat data preparation benchmark #1573

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add landsat data preparation benchmark #1573

wants to merge 1 commit into from

Conversation

phofl
Copy link
Contributor

@phofl phofl commented Oct 25, 2024

A test run is passing locally, so we should be good to go

quantile is so slow that it would explode our runtime, so using median here

@phofl phofl marked this pull request as draft October 25, 2024 11:04
@phofl phofl marked this pull request as ready for review October 28, 2024 09:39
Copy link
Member

@hendrikmakait hendrikmakait left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please separate query execution from workload definition (following the example of #1579.

14.497958439404897,
5.052677334304235,
)
elif scale == "large":
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We haven't really thought too much about scaling in the past. What's the significance of these scaling dimensions? Is it larger an increase data size and more (embarassingly parallel) variables?

@hendrikmakait hendrikmakait self-requested a review November 11, 2024 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants