INSEE: solve dulplicate series codes
Description
Convert job shows warnings like
WARNING:__main__:2021-02-24 11:03:37,404:CNA-2014-CSI/A.CNA_COMPTES_SI_RP.S11.RP.B8G.PROPORTION_POURCENTAGE.FR-D976.POURCENT.BRUT: duplicate series code, skipping...
WARNING:__main__:2021-02-24 11:04:13,924:DECES-MORTALITE/A.ESPERANCE_VIE.VALEUR_ABSOLUE.ESPV-20.FE.1.SO.ANNEES.BRUT: duplicate series code, skipping...
WARNING:__main__:2021-02-24 11:04:13,925:DECES-MORTALITE/A.ESPERANCE_VIE.VALEUR_ABSOLUE.ESPV-20.FE.2.SO.ANNEES.BRUT: duplicate series code, skipping...
WARNING:__main__:2021-02-24 11:04:13,925:DECES-MORTALITE/A.ESPERANCE_VIE.VALEUR_ABSOLUE.ESPV-20.FM.1.SO.ANNEES.BRUT: duplicate series code, skipping...
Cf this job
These warnings are not reported on the dashboard and can hide data-related problems.
Tasks
-
solve the problem if it's a bug in the convert script -
in any case append this error to the ErrorArtifact
instead of just logging it