Skip to content

Add a benchmarking script and directory to house test suite and results.#194

Open
dandragona-dev wants to merge 2 commits intoquantumlib:mainfrom
dandragona-dev:benchmarking-script
Open

Add a benchmarking script and directory to house test suite and results.#194
dandragona-dev wants to merge 2 commits intoquantumlib:mainfrom
dandragona-dev:benchmarking-script

Conversation

@dandragona-dev
Copy link
Collaborator

@dandragona-dev dandragona-dev commented Feb 23, 2026

  • Builds "main" as a baseline and uses Hyperfine to compare the current directory against this baseline.
  • Test suite added with four different error correction code groups. These circuits take a while, so a full run can potentially take hours. Should I just change it to be smaller circuits?
  • Creates results directories for each run with whisker plots and stat summaries.

Creates whisker plots like:
results_r18_d18_p0 001_bivariate_bicycle_X

@dandragona-dev dandragona-dev requested a review from a team as a code owner February 23, 2026 04:05
@dandragona-dev dandragona-dev requested review from LalehB and removed request for a team February 23, 2026 04:05
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if we can disclose the type of code etc. that this is, sort of like the file names in testdata/.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed this too.

* Builds "main" as a baseline and uses Hyperfine to compare the current directory against
  this baseline.
* Testsuite added with four different error correction code groups.
* Creates results directories for each run with whisker plots and stat
  summaries.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants