Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove giant static QV file from benchmarks #13919

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

mtreinish
Copy link
Member

Summary

The qasm2 import benchmarks included a qasm file that was a transpiled 100 qubit quantum volume circuit that was taken from benchpress. This qasm file had ~300,000 lines and was only being used as a benchmark of the qasm2 importer. However, this file is unnecessarily large in the repo when we can just generate a large qasm file ourselves for the benchmark. This commit removes the file and rewrites the benchmark to generate a qasm file on the fly.

Details and comments

The qasm2 import benchmarks included a qasm file that was a transpiled
100 qubit quantum volume circuit that was taken from benchpress. This
qasm file had ~300,000 lines and was only being used as a benchmark of
the qasm2 importer. However, this file is unceessarily large in the repo
when we can just generate a large qasm file ourselves for the benchmark.
This commit removes the file and rewrites the benchmark to generate a
qasm file on the fly.
@mtreinish mtreinish added type: qa Issues and PRs that relate to testing and code quality mod: qasm2 Relating to OpenQASM 2 import or export Changelog: None Do not include in changelog labels Feb 24, 2025
@mtreinish mtreinish requested a review from a team as a code owner February 24, 2025 18:03
@qiskit-bot
Copy link
Collaborator

One or more of the following people are relevant to this code:

  • @Qiskit/terra-core

Copy link
Member

@jakelishman jakelishman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general this seems like a sensible thing to do, though we should be super confident that we're not blowing out the timeout in the setup - I know the quantum_volume function referred to here is still some super old one that's vendored into the benchmark suite to avoid invalidating the benchmarks when the Qiskit version updates.

@coveralls
Copy link

coveralls commented Feb 24, 2025

Pull Request Test Coverage Report for Build 13566798063

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • 5 unchanged lines in 2 files lost coverage.
  • Overall coverage increased (+0.01%) to 87.873%

Files with Coverage Reduction New Missed Lines %
crates/accelerate/src/unitary_synthesis.rs 1 94.39%
crates/qasm2/src/lex.rs 4 92.48%
Totals Coverage Status
Change from base Build 13553732677: 0.01%
Covered Lines: 77543
Relevant Lines: 88244

💛 - Coveralls

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Changelog: None Do not include in changelog mod: qasm2 Relating to OpenQASM 2 import or export type: qa Issues and PRs that relate to testing and code quality
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants