ILO - International Labour Organization

• As a system
• I want to include acquire ILO data
• in order to provide them in the DBnomics application.

Tasks

• Download 12 dictionaries in CSV files (MUST)
• Download 450 datasets CSV.gz files (MUST)
• Convert 450 CSV datafiles with similar structures (MUST)
• Obtain the hierarchy of categories and updating information from table of content file (SHOULD)

Acceptance criteria

• there must be as many data files downloaded as there are rows in Table of Contents (minus one for the header row)
• each dataset must have as many records as indicated in table of contents (column J)
• the code of each dimensions in the columns before the "time"column must be augmented by their label contained in the dictionaries
• CSV data file column obs_status must be treated as attribute.
• CSV data file columns note_classif, note_indicator and note_source must be copied in series_note
• the category hierarchy must replicate Indicators by subject in http://www.ilo.org/ilostat/faces/ilostat-home/home?_adf.ctrl-state=17rratf4o8_4&_afrLoop=172365535948069#!, (but the source is the table_of_contents file)
• the system must trigger an update of a dataset if the date of last update in column I of Table of Contents is posterior to the date of last update recorded in the database

The above checks don't need to be included in the production code

Resources

Fetcher description: ILO.md

Technical steps