Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: remove exclude-empty option #213

Merged
merged 1 commit into from
Oct 13, 2024

Conversation

P403n1x87
Copy link
Owner

@P403n1x87 P403n1x87 commented Feb 29, 2024

Description of the Change

The option has been broken for the past few releases and it didn't seem to cause major issues. So we make the assumption that this option is not used frequently and therefore we decided to drop it.

@P403n1x87 P403n1x87 modified the milestones: Austin 3, Austin 3.7 Feb 29, 2024
Copy link

codecov bot commented Feb 29, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 68.59%. Comparing base (dd5b67e) to head (9804459).
Report is 2 commits behind head on devel.

Additional details and impacted files
@@            Coverage Diff             @@
##            devel     #213      +/-   ##
==========================================
- Coverage   68.73%   68.59%   -0.14%     
==========================================
  Files          27       27              
  Lines        2568     2563       -5     
  Branches      787      786       -1     
==========================================
- Hits         1765     1758       -7     
+ Misses        463      461       -2     
- Partials      340      344       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Feb 29, 2024

Austin Benchmarks

Running Austin benchmarks with Python 3.10.15

Benchmark Summary

Comparison of dev against 3.6.0.

The following scenarios show a statistically significant difference in performance between the two versions.

Sample Rate Saturation Error Rate Sampling Speed
Wall time [sampling interval: 1] 🟡 🟡 🟡 🟢
Wall time [sampling interval: 10] 🟡 🟢 🟡 🟡
Full metrics [sampling interval: 100] 🟡 🟡 🔴 🟡
Multiprocess wall time [sampling interval: 10] 🟡 🟡 🔴 🟡
Multiprocess wall time [sampling interval: 100] 🟢 🟡 🟡 🟡
Multiprocess wall time [sampling interval: 1000] 🟡 🟡 🔴 🟡

Benchmark Results

Wall time [sampling interval: 1]

Wall time [sampling interval: 1]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 102000 ± 2000 1 ± 0 1e-05 ± 1e-05 15.4 ± 0.5
dev 104000 ± 2000 1 ± 0 1.5e-05 ± 5e-06 14.6 ± 0.7
Wall time [sampling interval: 10]

Wall time [sampling interval: 10]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 100000 ± 5000 0.91 ± 0.02 1e-05 ± 1e-05 15.4 ± 0.5
dev 99000 ± 4000 0.85 ± 0.02 1.4e-05 ± 2e-06 15.2 ± 0.4
Wall time [sampling interval: 100]

Wall time [sampling interval: 100]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 12200 ± 200 0.0009 ± 0.0002 6e-05 ± 5e-05 16.8 ± 0.6
dev 12200 ± 200 0.0008 ± 0.0004 3e-05 ± 3e-05 16.5 ± 0.5
Wall time [sampling interval: 1000]

Wall time [sampling interval: 1000]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 1850 ± 30 0 ± 0 0.0001 ± 0.0002 17.9 ± 1.0
dev 1860 ± 30 0 ± 0 0.0001 ± 0.0002 18.1 ± 0.7
CPU time [sampling interval: 1]

CPU time [sampling interval: 1]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 30400 ± 900 1 ± 0 4e-05 ± 3e-05 26.4 ± 0.5
dev 30300 ± 1000 1 ± 0 7e-05 ± 3e-05 26.5 ± 1.0
CPU time [sampling interval: 10]

CPU time [sampling interval: 10]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 30000 ± 1000 1 ± 0 6e-05 ± 3e-05 27.0 ± 0.8
dev 30000 ± 1000 1 ± 0 8e-05 ± 3e-05 27 ± 1
CPU time [sampling interval: 100]

CPU time [sampling interval: 100]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 6290 ± 10 0.0019 ± 0.0006 0.0002 ± 0.0001 31 ± 1
dev 6290 ± 20 0.003 ± 0.001 0.0001 ± 0.0002 31 ± 1
CPU time [sampling interval: 1000]

CPU time [sampling interval: 1000]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 946 ± 2 0.0001 ± 0.0002 0.0001 ± 0.0003 33 ± 2
dev 946 ± 2 0 ± 0 0.0001 ± 0.0002 33 ± 2
RSA keygen [sampling interval: 1]

RSA keygen [sampling interval: 1]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 32000 ± 1000 1 ± 0 0.0002 ± 0.0002 30 ± 1
dev 28000 ± 10000 1 ± 0 0.002 ± 0.005 100 ± 200
RSA keygen [sampling interval: 10]

RSA keygen [sampling interval: 10]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 31000 ± 1000 1 ± 0 0.0004 ± 0.0005 32 ± 2
dev 31000 ± 2000 1 ± 0 0.0006 ± 0.0003 32 ± 2
RSA keygen [sampling interval: 100]

RSA keygen [sampling interval: 100]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 6290 ± 20 0.02 ± 0.03 0.002 ± 0.002 38 ± 5
dev 6290 ± 20 0.02 ± 0.02 0.0014 ± 0.0005 37 ± 4
RSA keygen [sampling interval: 1000]

RSA keygen [sampling interval: 1000]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 942 ± 3 0 ± 0 0.001 ± 0.002 40 ± 8
dev 942 ± 1 0 ± 0 0.002 ± 0.004 40 ± 5
Full metrics [sampling interval: 1]

Full metrics [sampling interval: 1]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 39100 ± 900 1 ± 0 3e-05 ± 3e-05 38.9 ± 0.7
dev 38700 ± 1000 1 ± 0 5e-05 ± 2e-05 39 ± 1
Full metrics [sampling interval: 10]

Full metrics [sampling interval: 10]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 39300 ± 700 1 ± 0 6e-05 ± 4e-05 38.6 ± 0.5
dev 38700 ± 500 1 ± 0 6e-05 ± 2e-05 39 ± 1
Full metrics [sampling interval: 100]

Full metrics [sampling interval: 100]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 12100 ± 200 0.0048 ± 0.0008 5e-05 ± 7e-05 43 ± 1
dev 12200 ± 200 0.005 ± 0.001 0.00014 ± 8e-05 43 ± 2
Full metrics [sampling interval: 1000]

Full metrics [sampling interval: 1000]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 1840 ± 30 0.0001 ± 0.0002 0.0002 ± 0.0003 46 ± 2
dev 1830 ± 70 0 ± 0 0.0001 ± 0.0002 46 ± 2
Multiprocess wall time [sampling interval: 1]

Multiprocess wall time [sampling interval: 1]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 3900 ± 300 1 ± 0 0.0003 ± 0.0001 230 ± 20
dev 4000 ± 100 1 ± 0 0.00031 ± 7e-05 236 ± 8
Multiprocess wall time [sampling interval: 10]

Multiprocess wall time [sampling interval: 10]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 3600 ± 700 1 ± 0 0.0002 ± 0.0001 230 ± 20
dev 4100 ± 100 1 ± 0 0.00033 ± 8e-05 231 ± 8
Multiprocess wall time [sampling interval: 100]

Multiprocess wall time [sampling interval: 100]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 3300 ± 700 0.033 ± 0.007 0.0002 ± 0.0001 220 ± 40
dev 4100 ± 200 0.036 ± 0.003 0.00018 ± 5e-05 230 ± 10
Multiprocess wall time [sampling interval: 1000]

Multiprocess wall time [sampling interval: 1000]

Sample Rate Saturation Error Rate Sampling Speed
3.6.0 3600 ± 400 0.011 ± 0.007 3e-05 ± 3e-05 130 ± 50
dev 3720 ± 80 0.009 ± 0.003 8e-05 ± 3e-05 110 ± 10

@P403n1x87 P403n1x87 force-pushed the refactor/remove-exclude-empty branch 3 times, most recently from 62dcd8e to b2dd9c8 Compare March 16, 2024 19:21
@P403n1x87 P403n1x87 force-pushed the refactor/remove-exclude-empty branch from b2dd9c8 to bf26fb9 Compare October 13, 2024 12:11
The option has been broken for the past few releases and it didn't
seem to cause major issues. So we make the assumption that this option
is not used frequently and therefore we make the decision to drop it.
@P403n1x87 P403n1x87 force-pushed the refactor/remove-exclude-empty branch from bf26fb9 to 9804459 Compare October 13, 2024 12:13
@P403n1x87 P403n1x87 marked this pull request as ready for review October 13, 2024 12:15
@P403n1x87 P403n1x87 merged commit d50ab47 into devel Oct 13, 2024
35 of 46 checks passed
@P403n1x87 P403n1x87 deleted the refactor/remove-exclude-empty branch October 13, 2024 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant