management issueshttps://git.nomics.world/dbnomics-fetchers/management/-/issues2022-03-01T16:49:00Zhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/1027refactor UNCTAD fetcher2022-03-01T16:49:00ZMichel Juillardrefactor UNCTAD fetcher- Bulk download is available
- CSV files
- Updated files are announced on RSS feed- Bulk download is available
- CSV files
- Updated files are announced on RSS feed2022-04-05Michel JuillardMichel Juillardhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/856FAO convert fails2020-12-22T08:30:23ZMichel JuillardFAO convert failsFor FAO fetcher ``convert.py`` has failed for several day. The last time that the data have been updated is November 11, 2020.
See https://git.nomics.world/dbnomics-fetchers/fao-fetcher/-/jobs/314197For FAO fetcher ``convert.py`` has failed for several day. The last time that the data have been updated is November 11, 2020.
See https://git.nomics.world/dbnomics-fetchers/fao-fetcher/-/jobs/314197https://git.nomics.world/dbnomics-fetchers/management/-/issues/607Eurostat validation2020-03-23T11:31:24ZThomas BrandEurostat validationWe can't see in the dashboard green validate for Eurostat, but only "no validation job found in the 1000 latest jobs." As this is a fetcher star, it seems important to have the information.
There are potentially three related issues : #4...We can't see in the dashboard green validate for Eurostat, but only "no validation job found in the 1000 latest jobs." As this is a fetcher star, it seems important to have the information.
There are potentially three related issues : #484 , #485 , #486, opened by @bduye . Iteration 2020-01-29Christophe Benzchristophe.benz@nomics.worldChristophe Benzchristophe.benz@nomics.worldhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/605Fetcher SAMA doesn't see that data have changed2019-12-05T17:36:56ZMichel JuillardFetcher SAMA doesn't see that data have changedWe collect yearly and monthly data from SAMA. However on DBnomics, the data haven't been update. From the dashboard the daily download runs OK but the procedure doesn't see that the files are different than the ones stored in dbnomics-so...We collect yearly and monthly data from SAMA. However on DBnomics, the data haven't been update. From the dashboard the daily download runs OK but the procedure doesn't see that the files are different than the ones stored in dbnomics-source-data/sama-source-data.
If one rune SAMA fetcher in a different infrastructure the downloaded files are indeed the expected fileshttps://git.nomics.world/dbnomics-fetchers/management/-/issues/583CSO: validation failed - unordered-observations-periods: 12020-03-23T11:34:04ZChristophe Benzchristophe.benz@nomics.worldCSO: validation failed - unordered-observations-periods: 1https://git.nomics.world/dbnomics/dbnomics-data-model/-/jobs/177182
https://git.nomics.world/dbnomics/dbnomics-data-model/-/jobs/177182
https://git.nomics.world/dbnomics-fetchers/management/-/issues/575ECB: series B.U2.EUR.4F.KR.MRR_MBR.LEV has weird periods2019-11-22T12:49:18ZMichel JuillardECB: series B.U2.EUR.4F.KR.MRR_MBR.LEV has weird periodsSeries Business – Euro area (changing composition) – Euro – ECB – Key interest rate – ECB Main refinancing operations - variable rate tenders (minimun bid rate) (date of changes) – Level report is only available for dates where the rate ...Series Business – Euro area (changing composition) – Euro – ECB – Key interest rate – ECB Main refinancing operations - variable rate tenders (minimun bid rate) (date of changes) – Level report is only available for dates where the rate has changed but the table displays
```
Period Value
2000-B3 4.25
2000-B5 4.5
2000-B5 4.75
2001-B3 4.5
```
where the sub-period can't be interpreted
In the same dataset (FM) if one selects frequency = B, one obtains, daily, bi-annual and bi-monthly series
There seems to be an issue with the interpretation of frequency == B and its handling by the fetcherhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/274Add schema.org dataset JSON-LD to improve SEO2021-03-26T11:28:31ZJohan RicherAdd schema.org dataset JSON-LD to improve SEO- Add markup specific to dataset: https://developers.google.com/search/docs/data-types/dataset
See also: https://schema.org/Dataset- Add markup specific to dataset: https://developers.google.com/search/docs/data-types/dataset
See also: https://schema.org/DatasetChristophe Benzchristophe.benz@nomics.worldChristophe Benzchristophe.benz@nomics.worldhttps://git.nomics.world/dbnomics-fetchers/management/-/issues/176Start implementing core features to access old revisions of a series2020-11-27T10:39:01ZChristophe Benzchristophe.benz@nomics.worldStart implementing core features to access old revisions of a seriesEPIC: #519
Goals:
- web API can list revisions of either provider/dataset/series
- web API can view a specific revision of either provider/dataset/series
- clients can add a `revision` parameter to the fetch functions
- user can list r...EPIC: #519
Goals:
- web API can list revisions of either provider/dataset/series
- web API can view a specific revision of either provider/dataset/series
- clients can add a `revision` parameter to the fetch functions
- user can list revisions of a dataset or series on the website
- user can view and download (XLS, CSV...) a specific revision of a dataset or series on the web site
### Tasks
First step is to implement the feature in the data model layer, so that it can be ran manually via a script – before adding it to the API and website.
Implement in dbnomics-data-model:
- [ ] access list of revisions of a series
- [ ] access past revision of a series `get_series(series_id, revision_id=<commit_id>)` (optional: by date)
- [ ] access list of revisions of a dataset
- [ ] access past revision of a dataset metadata (think about it and add precision to the task list...)
- [ ] create a CLI script like `find_series_at_revision.py <series_id> <revision_id>` (and another one for datasets, or a script with more options...) returning JSON/TSV data depending on the requested data
Later:
- [ ] propose new API endpoints or parameters
- [ ] add revision features to data storage layer
- [ ] add revision features to web API
- [ ] add revision features to Python client
- [ ] add revision features to web site
Extra:
- check if the time series editor can load a time series at revisionChristophe Benzchristophe.benz@nomics.worldChristophe Benzchristophe.benz@nomics.world