Milestones

List view

• Measurement Bias Mitigated

  This group of work covers everything required to implement our measurement bias mitigations. Once completed, we can be confident that the source changes are the cause of any speed up or slow down, and not any incidental code, data, or heap layout changes. See the [RFC](https://github.com/bytecodealliance/rfcs/blob/main/accepted/benchmark-suite.md#incremental-milestones) for more details.

  No due date

  •1/2 issues closed
  50% complete1 open1 closed

• Statistically Sound and Rigorous Analysis

  The MVP analysis will only do a simple test of significance for the difference in performance with and without a given change. This will tell us whether any difference really exists or is just noise, but it won't tell us what we really want to know: how much faster or slower did it get?! Implementing an effect size confidence interval analysis will give us exactly that information. See the [RFC](https://github.com/bytecodealliance/rfcs/blob/main/accepted/benchmark-suite.md#incremental-milestones) for more details.

  No due date

  •2/3 issues closed
  66% complete1 open2 closed