Lbron 1322 script for downloading datasets

[JonasVanHoof]

🗒️ Description

We want to have an export of all the triples per subset and per municipality. Preferably queries that can be run in a script so we can call it later in a cron job or something simular.

Subsets:

• codelists
• restricted mobility zones
• expressions/work/manifests
• human-validations

🦮 How to test

1. use the test database dump
2. Run the extractions for every subset (make sure you have a dataset that contains these values as otherwise the output files will be empty ;p)

cd ../scripts/download_datasets

python extract_ttl_to_file.py --list # Lists all jobs use the name of one in the next command

python extract_ttl_to_file.py --job codelists

=== Job: Codelist annotations (SDG) for municipality ===

[Step 1] Counting distinct subjects (?annotation  ?activity  ?agent) …
  [Step 1] ?annotation: 75 distinct
  [Step 1] ?activity: 2 distinct
  [Step 1] ?agent: 1 distinct
[Step 1] 78 distinct subject URIs → 1 batch(es) of 100000 (4 parallel)
  [Step 1] 1/1 batches done
[Step 1] Done. 78 distinct subject URIs queued.
[Pipeline] Processed 78 subjects …[Pipeline] Tmp graph is empty – extraction complete.

[Pipeline] Finished. 78 subjects written to './output/codelists.ttl'.