Rosstat - Russian Federal State Statistics Service
- As a system
- I want to acquire data from Rosstat
- in order to diffuse them on DBnomics
TASKS
-
download HTML data on production with link in NSDS sheet http://www.gks.ru/bgd/free/B00_25/IssWWW.exe/Stg/d000/I000600R.HTM (MUST) -
download HTML data on labor force with link in NSDS sheet (MUST) -
download HTML data on wages with link in NSDS sheet (MUST) -
download HTML data on CPI with link in NSDS sheet (MUST) -
download HTML data on PPI with link in NSDS sheet (MUST) -
download Excel data on consolidated budget at http://old.minfin.ru/en/statistics/index.php (COULD) -
convert HTML and Excel data DBnomics JSON [MUST] -
define and store categories for Rosstat (SHOULD) -
define and implement updating stategy (SHOULD)
Acceptance criteria
-
5 groups of HTML data MUST be downloaded -
1 Excel datasets COULD be downloaded -
the data MUST be converted to DBnomics JSON in 2 datasets -
2 categories MUST be stored -
update policy MUST be defined -
parsing errors MUST be logged
Resources
Fetcher description rosstat
Technical steps
Edited by Christophe Benz