Issue 102 ons converter
All threads resolved!
All threads resolved!
Related to management#102 (closed)
Could you make a review Scrum Master? @cbenz
ONS Downloader + ONS Converter
REMAINING:
-
download every page for each steps (provider, category) -
Name of categories and datasets MUST be the title of the HTML page -
Dataset MUST have a description
Edited by Christophe Benz
Merge request reports
Activity
Filter activity
assigned to @cbenz
added 10 commits
-
54fe16d9...9a913cd9 - 2 commits from branch
master
- 04901533 - ADD ONS_to_db_nomics: buid the tree till dataset.json
- 95c1370a - comment #ToDO get friendly human name from source_page?
- 8770e9b0 - Changed local path to cli path
- 86d9fda4 - ADD build_datasets_and_series
- 140106ed - [WIP] Adding series and observations. (Left datasets for the moment)
- fe5a9ad7 - Make the file executable
- be888d43 - created dataset.json
- bff29880 - sort import
Toggle commit list-
54fe16d9...9a913cd9 - 2 commits from branch
marked as a Work In Progress from 140106ed
- Resolved by Christophe Benz
Here is a list of thoughts:
- Rename
ons_to_db_nomics.py
toons_to_dbnomics.py
to be consistent with other fetchers - Do not hardcode
source_dir
andtarget_dir
with the path on your machine
Otherwise, I could run the script and it writes files, but I did not check them for now.
That's all for now, thanks!
- Rename
added 20 commits
- 00e5fc6e - ADD ONS_to_db_nomics: buid the tree till dataset.json
- ad0a2f62 - comment #ToDO get friendly human name from source_page?
- 735146bc - Changed local path to cli path
- 14fc27d6 - ADD build_datasets_and_series
- 14c9e5ff - [WIP] Adding series and observations. (Left datasets for the moment)
- 601a6361 - Make the file executable
- 42c1d8ce - created dataset.json
- 6f456df5 - sort import
- 1201cd19 - Assert with msg error
- 92b24bc1 - [WIP] add source_pages for each step
- 6399d981 - WIP: donwload source_file for each step of the tree
- 8d550592 - Download HTML source_page
- 16e15ed0 - Remove debug print
- db3508c4 - Comment git integration
- 9625115f - Download source pages
- 46cfe8a5 - Merge branch 'issue102_ONS-converter-remaining' into issue-102_ONS-converter
- c0147053 - Adding names to datasets and categories + datasets descriptions
- 732f5a3c - removing hardcoded dir
- 973658d1 - Renaming
- 5d3a310e - GIT integration
Toggle commit listadded 24 commits
- 5688f574 - ADD ONS_to_db_nomics: buid the tree till dataset.json
- 3187739a - comment #ToDO get friendly human name from source_page?
- 03dc3623 - Changed local path to cli path
- 7d416521 - ADD build_datasets_and_series
- 4535d06b - [WIP] Adding series and observations. (Left datasets for the moment)
- 931364ca - Make the file executable
- a9e81bc9 - created dataset.json
- 9e5aeffc - sort import
- f06d40be - WIP: donwload source_file for each step of the tree
- 0425ece4 - Download HTML source_page
- d88015c8 - Remove debug print
- e10726b8 - Comment git integration
- 0ce35cb6 - ADD ONS_to_db_nomics: buid the tree till dataset.json
- 57c3bef3 - comment #ToDO get friendly human name from source_page?
- 3c4d58ea - Changed local path to cli path
- f35d3008 - ADD build_datasets_and_series
- 3f5196da - [WIP] Adding series and observations. (Left datasets for the moment)
- 6d5e4673 - Make the file executable
- 1cddc9b4 - created dataset.json
- 00d0d47c - Download source pages
- 17ea9fb3 - Adding names to datasets and categories + datasets descriptions
- 4464df67 - Renaming
- ec857bbc - GIT integration
- 158d3318 - Adding requirements
Toggle commit listadded 1 commit
- 6e207f6c - REMOVE option in case source_data folder not found or not a git repo