Skip to content

Test performance testing #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
ahoppen wants to merge 2 commits into from
Closed

Test performance testing #10

ahoppen wants to merge 2 commits into from

Conversation

@ahoppen
Copy link
Owner

@ahoppen ahoppen commented Apr 24, 2025

No description provided.

@ahoppen ahoppen force-pushed the regress-performance branch from 4625c2d to 77bf7da Compare April 24, 2025 10:59
@ahoppen ahoppen force-pushed the regress-performance branch from 77bf7da to d6df086 Compare April 24, 2025 11:01
@ahoppen ahoppen force-pushed the regress-performance branch from d6df086 to ce39334 Compare April 24, 2025 11:03
@ahoppen ahoppen force-pushed the regress-performance branch from ce39334 to c9be929 Compare April 24, 2025 11:06
@ahoppen ahoppen force-pushed the regress-performance branch from c9be929 to cc66df6 Compare April 24, 2025 11:09
@ahoppen ahoppen force-pushed the regress-performance branch from cc66df6 to 2cbe58d Compare April 24, 2025 11:19
@ahoppen ahoppen force-pushed the regress-performance branch from 2cbe58d to 2a7ea77 Compare April 24, 2025 11:21
@ahoppen ahoppen force-pushed the regress-performance branch from 2a7ea77 to a9ae03e Compare April 24, 2025 11:22
@ahoppen ahoppen force-pushed the regress-performance branch from a9ae03e to d4909e4 Compare April 24, 2025 11:23
@ahoppen ahoppen force-pushed the main branch 2 times, most recently from 859f4f3 to fa0b78c Compare April 24, 2025 11:25
@ahoppen ahoppen force-pushed the regress-performance branch from d4909e4 to 544b037 Compare April 24, 2025 11:25
@ahoppen ahoppen force-pushed the regress-performance branch from 544b037 to 2ee2f91 Compare April 24, 2025 11:45
@github-actions
Copy link

github-actions bot commented Apr 24, 2025

Header

@ahoppen ahoppen force-pushed the regress-performance branch from 2ee2f91 to 22801c2 Compare April 24, 2025 11:49
@github-actions
Copy link

github-actions bot commented Apr 24, 2025

This PR has changed performance characteristics. Please review that the measurements reported below are expected. If these are improvements, thanks for improving the performance.

Build complete!
Building BenchmarkTool in release mode...
Building benchmark targets in release mode for benchmark run...
Building MyBenchmark
Failed to load specified baseline 'main'.

@ahoppen ahoppen force-pushed the regress-performance branch from 22801c2 to 9d4e447 Compare April 24, 2025 11:59
@github-actions
Copy link

github-actions bot commented Apr 24, 2025

This PR has changed performance characteristics. Please review that the measurements reported below are expected. If these are improvements, thanks for improving the performance.

Failed to load specified baseline 'main'.

@github-actions
Copy link

github-actions bot commented Apr 25, 2025

This PR has changed performance characteristics. Please review that the measurements reported below are expected. If these are improvements, thanks for improving the performance.

New baseline 'regress-performance' is WORSE than the 'main' baseline thresholds.

@ahoppen ahoppen force-pushed the regress-performance branch from 6c18e44 to 9bd0ccb Compare April 25, 2025 06:22
@github-actions
Copy link

github-actions bot commented Apr 25, 2025

This PR has changed performance characteristics. Please review that the measurements reported below are expected. If these are improvements, thanks for improving the performance.

==========================================================
Threshold deviations for MyBenchmark:Fibonacci computation
==========================================================
Time (user CPU) (ms, %) main regress-perfor… Difference % Threshold %
p50 10 60 500 5
p75 10 60 500 5

New baseline 'regress-performance' is WORSE than the 'main' baseline thresholds.

@ahoppen ahoppen force-pushed the regress-performance branch from 9bd0ccb to 01859f3 Compare April 25, 2025 06:39
@ahoppen ahoppen force-pushed the regress-performance branch from 01859f3 to b6714a6 Compare April 25, 2025 06:42
@ahoppen ahoppen force-pushed the regress-performance branch from b6714a6 to 08df4b8 Compare April 25, 2025 06:45
@github-actions
Copy link

github-actions bot commented Apr 25, 2025

This PR has regressed performance characteristics. Please review whether the changes reported below are expected or if you can do something to improve them.

Performance report 
==========================================================
Threshold deviations for MyBenchmark:Fibonacci computation
==========================================================
Time (user CPU) (ms, %) main regress-perfor… Difference % Threshold %
p50 10 60 500 5
p75 10 60 500 5

New baseline 'regress-performance' is WORSE than the 'main' baseline thresholds.

@ahoppen ahoppen force-pushed the regress-performance branch from 08df4b8 to b0f7855 Compare April 25, 2025 07:14
@ahoppen ahoppen force-pushed the regress-performance branch from b0f7855 to 48e2c6c Compare April 25, 2025 07:18
@github-actions
Copy link

github-actions bot commented Apr 25, 2025

This PR has regressed performance characteristics. Please review whether the changes reported below are expected or if you can do something to improve them.

Performance report 
==========================================================
Threshold deviations for MyBenchmark:Fibonacci computation
==========================================================
Time (user CPU) (ms, %) main regress-perfor… Difference % Threshold %
p50 10 60 500 5
p75 10 60 500 5

New baseline 'regress-performance' is WORSE than the 'main' baseline thresholds.

@ahoppen ahoppen mentioned this pull request Apr 25, 2025
Merged
@ahoppen ahoppen force-pushed the main branch 9 times, most recently from 600db38 to 3452c5d Compare April 25, 2025 09:37
@ahoppen
Copy link
Owner Author

ahoppen commented Aug 4, 2025

Closing this effort since GitHub runners currently don’t support instruction counters, which is what we’d be interested in. swiftlang/github-workflows#114 (comment)

@ahoppen ahoppen closed this Aug 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@ahoppen