Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA]: Do not benchmark small problem sizes in CI #1242

Closed
1 task done
gevtushenko opened this issue Dec 26, 2023 · 0 comments · Fixed by #1243
Closed
1 task done

[FEA]: Do not benchmark small problem sizes in CI #1242

gevtushenko opened this issue Dec 26, 2023 · 0 comments · Fixed by #1243
Assignees
@gevtushenko
Labels
feature request New feature or request.

Comments

@gevtushenko
Copy link
Collaborator

Is this a duplicate?

Area

General CCCL

Is your feature request related to a problem? Please describe.

Benchmarking small problem sizes is noisy due to the way we collect samples. This prevents CI from setting any reasonable noise threshold for performance regressions (NVBug 4384377).

Describe the solution you'd like

We should stop benchmarking small problem sizes until we figure out NVIDIA/nvbench#150.

Describe alternatives you've considered

No response

Additional context

No response
@gevtushenko gevtushenko added the feature request New feature or request. label Dec 26, 2023
@gevtushenko gevtushenko self-assigned this Dec 26, 2023
@gevtushenko gevtushenko mentioned this issue Dec 26, 2023
Merged
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gevtushenko gevtushenko

Labels
feature request New feature or request.
Projects
CCCL
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Do not benchmark small problem sizes gevtushenko/cccl
1 participant
@gevtushenko