dbnomics-fetchers issueshttps://git.nomics.world/groups/dbnomics-fetchers/-/issues2024-02-07T14:30:27Zhttps://git.nomics.world/dbnomics-fetchers/bls-fetcher/-/issues/1BLS has restricted static files downloads2024-02-07T14:30:27ZChristophe Benzchristophe.benz@nomics.worldBLS has restricted static files downloadsSince 2023-12-28 the BLS seems to have restricted static files downloads.
## Reproducing the problem
```bash
curl 'https://download.bls.gov/pub/time.series/'
[...]
<p>The BLS is committed to providing data promptly and according to es...Since 2023-12-28 the BLS seems to have restricted static files downloads.
## Reproducing the problem
```bash
curl 'https://download.bls.gov/pub/time.series/'
[...]
<p>The BLS is committed to providing data promptly and according to established schedules. Automated retrieval programs (commonly called "robots" or "bots") can cause delays and interfere with other customers' timely access to information. Therefore, bot activity that doesn't conform to BLS usage policy is prohibited.</p>
<p>We apologize for any inconvenience. If you believe we have made an error, please <a href=https://data.bls.gov/forms/opb.htm?akamai-0.9c87dd58.1707315447.9e61379>contact us</a>.</p>
[...]
```
DBnomics should not violate [BLS terms of service](https://www.bls.gov/bls/pss.htm) and the API should be used (cf https://www.bls.gov/developers/).
## Links
- [last working job](https://git.nomics.world/dbnomics-fetchers/bls-fetcher/-/jobs/1269137)
- [first failing job](https://git.nomics.world/dbnomics-fetchers/bls-fetcher/-/jobs/1269927)https://git.nomics.world/dbnomics-fetchers/bdf-fetcher/-/issues/3Error 500 in /v1/catalogue API endpoint2024-01-12T14:28:31ZChristophe Benzchristophe.benz@nomics.worldError 500 in /v1/catalogue API endpointMail sent to Webstat team:
---
Bonjour l'équipe Webstat,
Depuis 3 jours j'observe une erreur 500 en appelant l'endpoint /v1/catalogue de l'API. J'ai également essayé depuis cette UI web : https://developer.webstat.banque-france.fr/pro...Mail sent to Webstat team:
---
Bonjour l'équipe Webstat,
Depuis 3 jours j'observe une erreur 500 en appelant l'endpoint /v1/catalogue de l'API. J'ai également essayé depuis cette UI web : https://developer.webstat.banque-france.fr/product/7559/api/4301
J'ai essayé depuis plusieurs machines à l'adresse IP différente et rien n'y fait.
Y a-t-il un bug temporaire ?
Exemple:
$ curl -H "x-ibm-client-id: $BDF_API_KEY" https://api.webstat.banque-france.fr/webstat-en/v1/catalogue
```html
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>500 Unknown Reason</title>
</head><body>
<h1>Unknown Reason</h1>
<p>The server encountered an internal error or
misconfiguration and was unable to complete
your request.</p>
<p>Please contact the server administrator at
root@localhost to inform them of the time this error occurred,
and the actions you performed just before this error.</p>
<p>More information about this error may be available
in the server error log.</p>
</body></html>
```https://git.nomics.world/dbnomics-fetchers/apple-fetcher/-/issues/1Apple series discontinued2023-12-13T19:55:09ZMichel JuillardApple series discontinuedAs of April 14, 2022, Apple is no longer providing COVID-19 mobility trends reports.As of April 14, 2022, Apple is no longer providing COVID-19 mobility trends reports.https://git.nomics.world/dbnomics-fetchers/ilo-fetcher/-/issues/1Distinguish dimensions from attributes2023-11-23T10:58:15ZChristophe Benzchristophe.benz@nomics.worldDistinguish dimensions from attributesFollowing a mail exchange with a DBnomics user:
\
You mentioned the provider ILO but not the dataset code: let's take for example "EMP_2EMP_SEX_AGE_NB" (https://db.nomics.world/ILO/EMP_2EMP_SEX_AGE_NB). \
\
Indeed it seems that the dime...Following a mail exchange with a DBnomics user:
\
You mentioned the provider ILO but not the dataset code: let's take for example "EMP_2EMP_SEX_AGE_NB" (https://db.nomics.world/ILO/EMP_2EMP_SEX_AGE_NB). \
\
Indeed it seems that the dimensions "ref_area" and "source" are fully correlated. \
\
Until now we consume ILO data by downloading their CSV files (cf https://www.ilo.org/ilostat-files/WEB_bulk_download/html/bulk_indicator.html), which do not distinguish the dimensions (constituting the series code) from the attributes (purely informative, don't appear in the series code). \
\
It seems clearly that the "source" should not be a dimension but an attribute. \
\
After looking twice at ILO website I just noticed that they offer a SDMX API here: https://ilostat.ilo.org/resources/sdmx-tools/ \
When requesting the same dataset, it appears that SDMX data distinguishes well the dimensions from the attributes: \
\
`<generic:Series> `\
`<generic:SeriesKey> `\
`<generic:Value id="REF_AREA" value="AFG"/> `\
`<generic:Value id="FREQ" value="A"/> `\
`<generic:Value id="MEASURE" value="EMP_2EMP_NB"/> `\
`<generic:Value id="SEX" value="SEX_T"/> `\
`<generic:Value id="AGE" value="AGE_YTHADULT_YGE15"/> `\
`</generic:SeriesKey> `\
`<generic:Obs> `\
`<generic:ObsDimension id="TIME_PERIOD" value="2013"/> `\
`<generic:ObsValue value="7255.05"/> `\
`<generic:Attributes> `\
`<generic:Value id="DECIMALS" value="1"/> `\
`<generic:Value id="UNIT_MEASURE" value="PS"/> `\
`<generic:Value id="UNIT_MULT" value="3"/> `\
`<generic:Value id="UNIT_MEASURE_TYPE" value="NB"/> `\
`<generic:Value id="SOURCE" value="ILO - Modelled Estimates"/> `\
`</generic:Attributes> `\
`</generic:Obs> `\
`</generic:Series>` \
\
So as long as we use CSV files, this will stay as-is. But thanks to your question, maybe we'll switch to SDMX; but in general consuming data over HTTP APIs is way slower than downloading bulk files.https://git.nomics.world/dbnomics-fetchers/obr-fetcher/-/issues/1Implement fetching a first series2023-07-17T08:50:56ZChristophe Benzchristophe.benz@nomics.worldImplement fetching a first seriesSource: https://obr.uk/efo/economic-and-fiscal-outlook-march-2023/
Hint: to avoid hard-coding the URL above, maybe take advantage of the redirection from https://obr.uk/efo to the URL
Original request:
> Les séries dont nous avons bes...Source: https://obr.uk/efo/economic-and-fiscal-outlook-march-2023/
Hint: to avoid hard-coding the URL above, maybe take advantage of the redirection from https://obr.uk/efo to the URL
Original request:
> Les séries dont nous avons besoin sont celles dans l'excel "Executive Summary" (le premier), en particulier l'onglet C1.3 (données d'emploi), colonne "march 2023 forecast".Baran AçıkelBaran Açıkelhttps://git.nomics.world/dbnomics-fetchers/undata-fetcher/-/issues/2Category tree is incomplete2023-06-26T13:39:22ZChristophe Benzchristophe.benz@nomics.worldCategory tree is incompleteThe category tree (https://db.nomics.world/UNDATA) has only 2 categories.
![image](/uploads/7ef20f7ab4680b0cee496cba1f0e0a0b/image.png)
The `convert.py` defines a `CATEGORY` with more categories.
Note: the "Population" category, now d...The category tree (https://db.nomics.world/UNDATA) has only 2 categories.
![image](/uploads/7ef20f7ab4680b0cee496cba1f0e0a0b/image.png)
The `convert.py` defines a `CATEGORY` with more categories.
Note: the "Population" category, now disappeared on provider side, has to be kept.
The category tree should be complete.https://git.nomics.world/dbnomics-fetchers/cso-fetcher/-/issues/4Implement incremental download2023-05-24T09:40:51ZChristophe Benzchristophe.benz@nomics.worldImplement incremental downloadCf https://github.com/CSOIreland/PxStat/wiki/API-Cube-RESTful#readcollection
e.g. https://ws.cso.ie/public/api.restful/PxStat.Data.Cube_API.ReadCollection/2023-04-20/enCf https://github.com/CSOIreland/PxStat/wiki/API-Cube-RESTful#readcollection
e.g. https://ws.cso.ie/public/api.restful/PxStat.Data.Cube_API.ReadCollection/2023-04-20/enhttps://git.nomics.world/dbnomics-fetchers/buba-fetcher/-/issues/3Some datasets have duplicate dimensions labels2023-04-07T10:37:53ZChristophe Benzchristophe.benz@nomics.worldSome datasets have duplicate dimensions labels## Example
https://db.nomics.world/BUBA/BBEX3
`Area (ISO currency codes, list of currencies)` is used twice, for `BBK_STD_CURRENCY` and `BBK_ERX_PARTNER_CURRENCY`.
```json
{
"dimensions_labels": {
"BBK_ERX_PARTNER_CURRENCY": "Ar...## Example
https://db.nomics.world/BUBA/BBEX3
`Area (ISO currency codes, list of currencies)` is used twice, for `BBK_STD_CURRENCY` and `BBK_ERX_PARTNER_CURRENCY`.
```json
{
"dimensions_labels": {
"BBK_ERX_PARTNER_CURRENCY": "Area (ISO currency codes, list of currencies)",
"BBK_ERX_RATE_TYPE": "Rate type",
"BBK_ERX_SERIES_TYPE": "Content of time series",
"BBK_ERX_SUFFIX": "Suffix",
"BBK_STD_CURRENCY": "Area (ISO currency codes, list of currencies)",
"BBK_STD_FREQ": "Frequency (BBk)"
}
}
```
![image](/uploads/86d688a8cf4c0763adfea428c289cd44/image.png)
## Fix
As the duplication comes from provider data, we should add a suffix to the duplicate labels to differentiate (e.g. `Area (ISO currency codes, list of currencies) (BBK_STD_CURRENCY)` and `Area (ISO currency codes, list of currencies) (BBK_ERX_PARTNER_CURRENCY)`.https://git.nomics.world/dbnomics-fetchers/fao-fetcher/-/issues/1Fetch more country code classifications2023-03-10T16:29:09ZChristophe Benzchristophe.benz@nomics.worldFetch more country code classificationsReceived by email:
I recently ran into a nuisance while trying to fetch a data. I’m fetching the FAO’s trade indices data:
https://www.fao.org/faostat/en/#data/TI
The problem is that the regional classification that it comes wi...Received by email:
I recently ran into a nuisance while trying to fetch a data. I’m fetching the FAO’s trade indices data:
https://www.fao.org/faostat/en/#data/TI
The problem is that the regional classification that it comes with is extremely inconvenient for me. It uses the FAO’s own classification for which I haven’t find a mapping. However, on the link above you see that you can select different regional classifications (M49, FAO, ISO2 and ISO3). Unfortunately DBnomics fetches the most inconvenient by default. Is there a way in DBnomics to select some other regional classification instead of the default? That would save me a lot of work.https://git.nomics.world/dbnomics-fetchers/undata-fetcher/-/issues/1A series has invalid periods2022-10-13T09:50:10ZChristophe Benzchristophe.benz@nomics.worldA series has invalid periodsCf https://sentry.io/organizations/dbnomics/issues/3065509812/?project=5548941&query=is%3Aunresolved
The series `UNDATA/NASEC_IDCNFSA_A/A.N.AM.W0.S14.S1.N.D.P51G._Z._Z._Z.XDC._Z.S.V.N._T` periods are empty strings.Cf https://sentry.io/organizations/dbnomics/issues/3065509812/?project=5548941&query=is%3Aunresolved
The series `UNDATA/NASEC_IDCNFSA_A/A.N.AM.W0.S14.S1.N.D.P51G._Z._Z._Z.XDC._Z.S.V.N._T` periods are empty strings.https://git.nomics.world/dbnomics-fetchers/cso-fetcher/-/issues/2A series has an invalid observation (".")2022-10-12T17:09:59ZChristophe Benzchristophe.benz@nomics.worldA series has an invalid observation (".")The series CSO/TSA07/TSA07C2.EU272020 has an observation value of `"."` which is invalid, in json-data.
Corresponding source-data file is https://git.nomics.world/dbnomics-source-data/cso-source-data/-/blob/master/TSA07.json
Cf https:/...The series CSO/TSA07/TSA07C2.EU272020 has an observation value of `"."` which is invalid, in json-data.
Corresponding source-data file is https://git.nomics.world/dbnomics-source-data/cso-source-data/-/blob/master/TSA07.json
Cf https://api.db.nomics.world/v22/series/CSO/TSA07/TSA07C2.EU272020?observations=1https://git.nomics.world/dbnomics-fetchers/management/-/issues/1123Add missing series for a Macroeconomic presentation2022-11-10T16:40:49ZChristophe Benzchristophe.benz@nomics.worldAdd missing series for a Macroeconomic presentation## Context
Some DBnomics users are building a Macroeconomic presentation, and some series from misc providers are missing on DBnomics. This issue tracks their integration.
## Series
- [x] Slide 4 : [OECD weekly growth tracker](https:/...## Context
Some DBnomics users are building a Macroeconomic presentation, and some series from misc providers are missing on DBnomics. This issue tracks their integration.
## Series
- [x] Slide 4 : [OECD weekly growth tracker](https://www.oecd.org/economy/weekly-tracker-of-gdp-growth/) (cf https://git.nomics.world/dbnomics-fetchers/oecd-fetcher/-/issues/1)
- [x] Slide 7: [consumer confidence index from University of Michigan](https://data.sca.isr.umich.edu)
- cf https://db.nomics.world/SCSMICH/MICS/ICS
- [ ] Priority [Cours du brent sur Nasdaq](https://www.nasdaq.com/fr/market-activity/commodities/bz:nmx/historical)
- Web page : https://www.nasdaq.com/fr/market-activity/commodities/bz:nmx/historical
- Raw data :
- Create a new provider with code NASDAQ and with name "Nasdaq"
- Create a new dataset with code BRENT and with name "Brent"
- [ ] Priority [Add Consumer price index to StatCan] (https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1810000401)
- Web Data : https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1810000401
- Create new dataset with Name "Consumer price index", with code "CPI"
- One dimension per item category
- [ ] Priority [Add Unemployment data at National Level to BLS provider (Bureau of labor statistics)]
- Web page and raw data : https://www.bls.gov/web/empsit/cpseea10.htm
- [ ] Priority [Add Notified vacancies dataset to Destatis provider]
- Web page and raw data : https://www.destatis.de/EN/Themes/Economy/Short-Term-Indicators/Labour-Market/karb830.html#249828
- [ ] Priority [Cours du WTI sur Nasdaq](https://www.nasdaq.com/market-activity/commodities/cl:nmx/historical)
- Web page: https://www.nasdaq.com/market-activity/commodities/cl:nmx/historical
- Raw data :
- Create a new dataset with code WTI and with name "WTI" to the existing provider Nasdaq
- [ ] Priority [Cours du Natural Gas sur Nasdaq](https://www.nasdaq.com/fr/market-activity/commodities/ng:nmx/historical)
- Web page: https://www.nasdaq.com/fr/market-activity/commodities/ng:nmx/historical
- Raw data:
- Create a new dataset NATURAL_GAS with name "Natural Gas" to the existing provider Nasdaq
- [ ] Priority [Cours du Copper sur Nasdaq](https://www.nasdaq.com/market-activity/commodities/hg:cmx/historical)
- [ ] Priority [Cours du CBOT Wheat sur Nasdaq](https://www.nasdaq.com/fr/market-activity/commodities/zw)
- Web Page: https://www.nasdaq.com/fr/market-activity/commodities/zw
- Raw data:
- Create a new dataset with code WHEAT and with name "Wheat" to the existing provider Nasdaq
- [x] Priority and already done on previous call (To be added) Extraire la base de donnée de [ICE](https://www.theice.com/), en particulier le cours du Dutch TTF
- Web page : https://www.theice.com/products/27996665/Dutch-TTF-Gas-Futures/data?marketId=5419234
- Raw data : https://www.theice.com/marketdata/DelayedMarkets.shtml?getHistoricalChartDataAsJson=&marketId=5508663&historicalSpan=3
- Create a new provider with code ICE and with name "Intercontinental Exchange"
- Create a new dataset with code DUTCH_TTF_GAS_FUTURES and with name "Dutch TTF Gas Futures"
- [x] Slide 11 : [Extraire les bases de données du site suivant](https://economy-finance.eceuropa.eu/economic-forecast-and-surveys/business-and-consumer-surveys/download-business-and-consumer-survey-data/time-series_en)
- Ok : cf : https://db.nomics.world/EC/CONSTRUCTION?dimensions=%7B%22country%22%3A%5B%22EU%22%5D%7D
- [ ] Priority [shipping container index de la base de données suivante](https://fbx.freightos.com)
- [ ] Priority (but difficult to get, an excel file is available for download on each publication) [Informations extraites de la Press room du site suivant, afin d’avoir le"Global reliability schedule"](https://www.sea-intelligence.com/press-room/155-schedule-reliability-improves-to-40-in-june-2022)
- [ ] Priority [Atlanta wage tracker](https://www.atlantafed.org/chcs/wage-growth-tracker)
- Web page:
- Raw data: /-/media/documents/datafiles/chcs/wage-growth-tracker/wage-growth-data.xlsx
- Create a new provider with code ATLANTA_FED and with name "Federal Reserve Bank of Atlanta"
- Create a new dataset with code WAGE_TRACKER and with name "Wage growth tracker"
- [ ] Priority [Fed nominal yield curve](https://www.federalreserve.gov/data/nominal-yield-curve.htm)
- Web page: https://www.federalreserve.gov/data/nominal-yield-curve.htm
- Raw data : /data/yield-curve-tables/feds200628.csv
- Create a new dataset with code "NOMINAL_YLD_CURVE" and with name "Nominal Yield Curve" to the existing Fed provider
- [ ] Priority [Fed TIPS and inflation compensation](https://www.federalreserve.gov/data/tips-yield-curve-and-inflation-compensation.htm)
- Web page: https://www.federalreserve.gov/data/tips-yield-curve-and-inflation-compensation.htm
- Raw data : data/yield-curve-tables/feds200805.csv
- Create a new dataset with code "TIPS_YLD_CURVE" and with name "TIPS and Inflation compensation" to the existing Fed provider
- [ ] Priority : [Database Banco di Espana] (https://www.bde.es/bde/en/areas/estadis/)
- Add complete database from the website : https://www.bde.es/bde/en/areas/estadis/
- [ ] Priority (the objective is to get the graph with High Yield US Corporate Spreads and High Yield Euro Corporate Spreads (cf. slide 36) [Base de données ICE Bofa](https://indices.theice.com)
- Web page: https://indices.theice.com
- Raw data:
- Create a new provider with code ICE_Bofa and with name "ICE Bofa"
-
- [ ] Priority [Indices du S&P 500](https://www.nasdaq.com/fr/market-activity/index/spx/historical)
- Web page: https://www.nasdaq.com/fr/market-activity/index/spx/historical
- Raw data:
- Create a new dataset with code "S&P500_INDICES" with name "S&P 500 Index" to the existing provider Nasdaq
- [ ] Slide 38 : [Indices du CAC 40](https://live.euronext.com/fr/product/index/FR0003500008-XPAR)
- [ ] Priority [indice de Shiller CAPE](http://www.econ.yale.edu/~shiller/data.htm)
- Web page: http://www.econ.yale.edu/~shiller/data.htm
- Raw data: data/ie_data.xls"
- Create a new provider with code "SHILLER" and with name "Robert Shiller"
- Create a new dataset with code CAPE_RATIO and with name "CAPE Ratio
- [ ] Priority [VIX index](https://www.cboe.com/tradable_products/vix/vix_historical_data/)
- Create a new provider CBOE
- Create a new dataset with name "VIX index" and with code "VIX_INDEX"
- [ ] Priority : Shiller CAPE ratios from Barclays
- web page: https://indices.barclays/IM/21/en/indices/static/historic-cape.app
- Create a new provider with name "Barclays" and with code "BARCLAYS"
- Have one dimension per countryhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/1122Recuring problems with docker on DBnomics fetcher2022-06-17T08:59:37ZMichel JuillardRecuring problems with docker on DBnomics fetcher## June 7th
- https://git.nomics.world/dbnomics-fetchers/ameco-fetcher/-/jobs/811912
- https://git.nomics.world/dbnomics-fetchers/bdf-fetcher/-/jobs/812327
- https://git.nomics.world/dbnomics-fetchers/boe-fetcher/-/jobs/811959
- https://...## June 7th
- https://git.nomics.world/dbnomics-fetchers/ameco-fetcher/-/jobs/811912
- https://git.nomics.world/dbnomics-fetchers/bdf-fetcher/-/jobs/812327
- https://git.nomics.world/dbnomics-fetchers/boe-fetcher/-/jobs/811959
- https://git.nomics.world/dbnomics-fetchers/cbo-fetcher/-/jobs/811989
- https://git.nomics.world/dbnomics-fetchers/drees-fetcher/-/jobs/812017
- https://git.nomics.world/dbnomics-fetchers/esri-fetcher/-/jobs/812091
- https://git.nomics.world/dbnomics-fetchers/ism-fetcher/-/jobs/812130
- restarted manually
+ several others not restartedChristophe Benzchristophe.benz@nomics.worldChristophe Benzchristophe.benz@nomics.worldhttps://git.nomics.world/dbnomics-fetchers/ec-fetcher/-/issues/1Convert Failed (IndexError)2022-05-31T09:04:44ZChristophe Benzchristophe.benz@nomics.worldConvert Failed (IndexError)Job [#806406](https://git.nomics.world/dbnomics-fetchers/ec-fetcher/-/jobs/806406) failed for a85617fd1fb805e4532a79ad54d2706358c39092:Job [#806406](https://git.nomics.world/dbnomics-fetchers/ec-fetcher/-/jobs/806406) failed for a85617fd1fb805e4532a79ad54d2706358c39092:https://git.nomics.world/dbnomics-fetchers/scb-fetcher/-/issues/1TypeError in data model while pushing json-data2022-05-18T08:41:18ZChristophe Benzchristophe.benz@nomics.worldTypeError in data model while pushing json-dataJob [#795360](https://git.nomics.world/dbnomics-fetchers/scb-fetcher/-/jobs/795360) failed for 7ea287f236f5b63ce542c4319c52ee872ed35bfb:Job [#795360](https://git.nomics.world/dbnomics-fetchers/scb-fetcher/-/jobs/795360) failed for 7ea287f236f5b63ce542c4319c52ee872ed35bfb:Christophe Benzchristophe.benz@nomics.worldChristophe Benzchristophe.benz@nomics.worldhttps://git.nomics.world/dbnomics-fetchers/nbs-fetcher/-/issues/3Download more data into the past2022-05-05T19:59:35ZChristophe Benzchristophe.benz@nomics.worldDownload more data into the pastThis issue follows an incoming email by an user.
Currently, only the latest 13 months are downloaded because this is the default from the provider side.
NBS UI offers a setting allowing to download up to the latest 36 months, or to spe...This issue follows an incoming email by an user.
Currently, only the latest 13 months are downloaded because this is the default from the provider side.
NBS UI offers a setting allowing to download up to the latest 36 months, or to specify a year interval (e.g. `2000-`).
The `FREQ_INFO_MAP` variable apparently defines a `latest` key, however it does not seem to be used.
Note: I do not know now to determine the first available year. So a loop must be written to dig into the past as long as there are results.
See also: https://data.stats.gov.cn/english/easyquery.htm
![image](/uploads/ebeabf0a7f9f006a02faf1839a4ce6c9/image.png)https://git.nomics.world/dbnomics-fetchers/management/-/issues/1119add dimension values to csv and xlsx files2022-04-18T09:04:26ZMichel Juillardadd dimension values to csv and xlsx files- As a user
- I want to know the value of the dimension of the series in the download file
- in order to sort the series
## Acceptance criteria
- [ ] MUST include dimension values in downloaded files
## Description
Context / how to ...- As a user
- I want to know the value of the dimension of the series in the download file
- in order to sort the series
## Acceptance criteria
- [ ] MUST include dimension values in downloaded files
## Description
Context / how to reproduce...
## Tasks
- [ ] add the dimension values below the numbers in csv and xlsx files2022-05-03https://git.nomics.world/dbnomics-fetchers/management/-/issues/1118DESTATIS download fails2022-04-11T17:31:54ZMichel JuillardDESTATIS download failsSee https://git.nomics.world/dbnomics-fetchers/destatis-fetcher/-/jobs/762833See https://git.nomics.world/dbnomics-fetchers/destatis-fetcher/-/jobs/7628332022-04-19Michel JuillardMichel Juillardhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/1117OPPINS: missing variables2022-04-03T09:21:46ZMichel JuillardOPPINS: missing variablesAdd new variables:
- WARNING:__main__:2022-04-03 11:16:18,803:Unrecognized COV variable new_booster_first_count
- WARNING:__main__:2022-04-03 11:16:18,803:Unrecognized COV variable booster_first_count
- WARNING:__main__:2022-04-03 11:16:...Add new variables:
- WARNING:__main__:2022-04-03 11:16:18,803:Unrecognized COV variable new_booster_first_count
- WARNING:__main__:2022-04-03 11:16:18,803:Unrecognized COV variable booster_first_count
- WARNING:__main__:2022-04-03 11:16:18,803:Unrecognized COV variable hospitalized_count
- WARNING:__main__:2022-04-03 11:16:18,804:Unrecognized COV variable new_booster_first_rate
- WARNING:__main__:2022-04-03 11:16:18,804:Unrecognized COV variable booster_first_rate
- WARNING:__main__:2022-04-03 11:16:18,804:Unrecognized COV variable hospitalized_rate
- WARNING:__main__:2022-04-03 11:16:18,900:Unrecognized COV variable booster_first_count
- WARNING:__main__:2022-04-03 11:16:18,930:Unrecognized COV variable new_booster_first_count
- WARNING:__main__:2022-04-03 11:16:18,965:Unrecognized COV variable hospitalized_count
- WARNING:__main__:2022-04-03 11:16:19,132:Unrecognized COV variable new_booster_first_rate
- WARNING:__main__:2022-04-03 11:16:19,132:Unrecognized COV variable booster_first_rate
- WARNING:__main__:2022-04-03 11:16:19,132:Unrecognized COV variable hospitalized_rate
- WARNING:__main__:2022-04-03 11:16:28,058:Unrecognized COV variable booster_first_count
- WARNING:__main__:2022-04-03 11:16:29,728:Unrecognized COV variable new_booster_first_count
- WARNING:__main__:2022-04-03 11:16:33,731:Unrecognized COV variable new_booster_first_rate
- WARNING:__main__:2022-04-03 11:16:33,731:Unrecognized COV variable booster_first_rate
- WARNING:__main__:2022-04-03 11:16:33,848:Unrecognized COV variable booster_first_count
- WARNING:__main__:2022-04-03 11:16:33,848:Unrecognized COV variable new_booster_first_count
- WARNING:__main__:2022-04-03 11:16:33,983:Unrecognized COV variable new_booster_first_rate
- WARNING:__main__:2022-04-03 11:16:33,983:Unrecognized COV variable booster_first_rate
- WARNING:__main__:2022-04-03 11:16:38,513:Unrecognized ZEARN variable imputed_from_cz
- WARNING:__main__:2022-04-03 11:16:38,821:Unrecognized EMP variable emp_size_0
- WARNING:__main__:2022-04-03 11:16:38,822:Unrecognized EMP variable emp_size_100
- WARNING:__main__:2022-04-03 11:16:38,822:Unrecognized EMP variable emp_size_500
- WARNING:__main__:2022-04-03 11:16:38,822:Unrecognized EMP variable emp_size_800
- WARNING:__main__:2022-04-03 11:16:38,822:Unrecognized EMP variable emp_advance2022-04-19Michel JuillardMichel Juillardhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/1115DGDDI convert fails2022-03-21T13:31:22ZMichel JuillardDGDDI convert failsAn expected file is missing. See https://git.nomics.world/dbnomics-fetchers/dgddi-fetcher/-/jobs/744351An expected file is missing. See https://git.nomics.world/dbnomics-fetchers/dgddi-fetcher/-/jobs/7443512022-03-08Michel JuillardMichel Juillard