BUBA validation failed
DBnomics validation script is getting more meticulous over time :-). It now warns if the same dimension code label is used by more than one dimension code.
This case occurs in BUBA fetcher. see job #38508:
$ dbnomics-validate --bare-repo-fallback ~/json-data/${PROVIDER_SLUG}-json-data
- Dataset "BUBA/BBDE1" at location BBDE1/dataset.json
Error code: duplicate-dimensions-values-labels
Message: Dimension label 'Free' appear more than once for dimension 'BBK_DO_SUFFIX' in dataset.json
Cause:
- Dataset "BUBA/BBDP1" at location BBDP1/dataset.json
Error code: duplicate-dimensions-values-labels
Message: Dimension label 'Total' appear more than once for dimension 'BBK_DOPR_CLASSIFICATION_DETAIL' in dataset.json
Cause:
...
Note: not all series of each datasets have been checked (maximum 100 per dataset actually).
To check all series of all datasets, use "--all-series" option
Encountered errors codes:
- duplicate-dimensions-values-labels: 23
ERROR: Job failed: exit status 1
These problems come from source SDMX codelists that contain duplicate labels. E.g.
- In file BBDE1.xml, code list
CL_BBK_DO_SUFFIX
contains 2 codes ('A' and 'A1') with the same label 'Free' - In file BBDP1.xml, code list
CL_BBK_DOPR_CLASSIF_DETAIL
contains 3 codes ('B1A0000000', 'GP09SA000000' and 'L1A00000000') with the same label 'Total'
What do we have to do in this case?