Skip to content

test: refresh the rai golden and compare it in full - #155

Open
renato-umeton wants to merge 1 commit into
mainfrom
test/refresh-rai-golden
Open

renato-umeton wants to merge 1 commit into
mainfrom
test/refresh-rai-golden

Conversation

@renato-umeton

Copy link
Copy Markdown
Collaborator

@slobentanzer the rai golden (tests/data/output/mimiciv_demo_croissant_rai.jsonld) was only checked on 8 rai/prov keys so the rest drifted from what we bake now..

what drifted:

what the test does now:

  • new test_rai_generation_matches_the_whole_reference bakes the same cmd and compares the whole doc w/ _discovery_independent, same as geo/hdf5/spreadsheets, in both discovery orders
  • the 8 key check stays as is
  • bake args moved to a small _bake_with_rai helper so both tests use the same cmd
  • golden regenerated w/ the cli + those args, nothing else touched

no timestamps or abs paths in the output so it's stable, also passes on 3.10 and 3.12 and w/ shuffled discovery. pls take a look, thx!

The RAI test compared eight keys against the golden, so the rest of the
file stopped matching what the tool bakes. Two output changes never
reached it: RAI runs declare the RAI spec in conformsTo (#69), and
compressed CSV files now also declare text/csv, ahead of
application/gzip (#117). The
file order also came from an older scan, so the text diff is large while
the content change is small.

The new test bakes the same command in both discovery orders and
compares the whole document through the normaliser the other goldens
use. The key check stays. The golden is regenerated with the CLI and the
arguments the test passes.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant