Skip to content
Snippets Groups Projects

Download data

Passed Started by
Christophe Benz
@cbenz
1Running with gitlab-runner 17.8.3 (690ce25c)
2 on Run fetchers JBzuiMazz, system ID: s_33ef491069c6
3 Preparing the "docker" executor 00:12
4Using Docker executor with image git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher:latest ...
5Authenticating with credentials from job payload (GitLab Registry)
6Pulling docker image git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher:latest ...
7Using docker image sha256:6a9063b7b761971c5f5c2d108450274544a93db48d89b61f787c6175beb7785e for git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher:latest with digest git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher@sha256:24f2f938c23581c30bb6c873b02e0e46563c7de31adf69afc36522a2597390f7 ...
8 Preparing environment 00:05
9Running on runner-jbzuimazz-project-445-concurrent-0 via tyche...
10 Getting source from Git repository 00:04
11Skipping Git repository setup
12Skipping Git checkout
13Skipping Git submodules setup
14 Executing "step_script" stage of the job script 00:12
15Using docker image sha256:6a9063b7b761971c5f5c2d108450274544a93db48d89b61f787c6175beb7785e for git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher:latest with digest git.nomics.world:4567/dbnomics-fetchers/franc-zone-fetcher@sha256:24f2f938c23581c30bb6c873b02e0e46563c7de31adf69afc36522a2597390f7 ...
16$ PROVIDER_DIR="${WORKSPACES_ROOT_DIR}/${PROVIDER_SLUG}" # collapsed multi-line command
17$ mkdir -p "$WORKSPACE_DEBUG_DATA_DIR" "$WORKSPACE_SOURCE_DATA_DIR"
18$ if [ "$DOWNLOAD_MODE" == "incremental" ]; then # collapsed multi-line command
19$ echo "Downloading data to $WORKSPACE_SOURCE_DATA_DIR ..."
20Downloading data to /data/dbnomics-prod/workspaces/franc-zone/pipelines/485789/source-data ...
21$ export DEBUG_DATA_DIR="$WORKSPACE_DEBUG_DATA_DIR"
22$ cd /app
23$ time python download.py "$WORKSPACE_SOURCE_DATA_DIR"
24 Downloading:
25 cemac_pib-nominal_fr.xlsx
26 Downloading:
27 cemac_tx-croissance-reel_fr.xlsx
28 Downloading:
29 cemac_prix-conso_fr.xlsx
30 Downloading:
31 cemac_exportations-de-biens_fr.xlsx
32 Downloading:
33 cemac_importations-de-biens_fr.xlsx
34 Downloading:
35 cemac_balance-commerciale_fr.xlsx
36 Downloading:
37 cemac_solde-cpte-courant-ext_fr.xlsx
38 Downloading:
39 cemac_solde-budget-base-eng_fr.xlsx
40 Downloading:
41 cemac_solde-budge-base-eng-pib_fr.xlsx
42 Downloading:
43 cemac_tx-investissement_fr_0.xlsx
44 Downloading:
45 cemac_dette-exterieure-totale_fr.xlsx
46 Downloading:
47 cemac_dette-exterieure-totale-pib_fr.xlsx
48 Downloading:
49 cemac_avoirs-exterieurs-nets_fr.xlsx
50 Downloading:
51 cemac_credits-economie_fr.xlsx
52 Downloading:
53 cemac_creances-nettes-sur-les-etats_fr.xlsx
54 Downloading:
55 cemac_masse-monetaire_fr.xlsx
56 Downloading:
57 cemac_masse-monetaire-pib_fr.xlsx
58 Downloading:
59 uemoa_pib-nominal_fr.xlsx
60 Downloading:
61 uemoa_tx-croissance-reel_fr.xlsx
62 Downloading:
63 uemoa_prix-conso_fr.xlsx
64 Downloading:
65 uemoa_exportations-de-biens_fr.xlsx
66 Downloading:
67 uemoa_importations-de-biens_fr.xlsx
68 Downloading:
69 uemoa_balance-commerciale_fr.xlsx
70 Downloading:
71 uemoa_solde-cpte-courant-ext_fr.xlsx
72 Downloading:
73 uemoa_solde-budget-base-eng_fr.xlsx
74 Downloading:
75 uemoa_solde-budget-base-engpib_fr.xlsx
76 Downloading:
77 uemoa_tx-investissement_fr.xlsx
78 Downloading:
79 uemoa_dette-exterieure-totale_fr.xlsx
80 Downloading:
81 uemoa_dette-exterieure-totalepib_fr.xlsx
82 Downloading:
83 uemoa_avoirs-exterieurs-nets_fr.xlsx
84 Downloading:
85 uemoa_credits-economie_fr.xlsx
86 Downloading:
87 uemoa_creances-nettes-sur-les-etats_fr.xlsx
88 Downloading:
89 uemoa_masse-monetaire_fr.xlsx
90 Downloading:
91 uemoa_masse-monetairepib_fr.xlsx
92 Downloading:
93 comores_fr.xlsx
94real 0m5.372s
95user 0m1.644s
96sys 0m0.155s
97$ if [ -f download_report.json ]; then # collapsed multi-line command
98$ if [ -f "$WORKSPACE_SOURCE_DATA_DIR/errors.json" ]; then # collapsed multi-line command
99$ rmdir --ignore-fail-on-non-empty "$WORKSPACE_DEBUG_DATA_DIR"
100 Uploading artifacts for successful job 00:04
101Uploading artifacts...
102WARNING: download_report.json: no matching files. Ensure that the artifact path is relative to the working directory (/builds/dbnomics-fetchers/franc-zone-fetcher)
103WARNING: errors.json: no matching files. Ensure that the artifact path is relative to the working directory (/builds/dbnomics-fetchers/franc-zone-fetcher)
104ERROR: No files to upload
105 Cleaning up project directory and file based variables 00:04
106Job succeeded