===============
ons
===============

Provider
========

:provider_name: ONS 
:provider_longname: Office for National Statistics 
:provider URL: http://ons.gov.uk
:region: UK
:terms of use: https://www.ons.gov.uk/help/termsandconditions
:approximate number of datasets: > 3000
   

Data accessibility
==================

:SDMX: no
:REST API: https://developer.ons.gov.uk/ Unusable for data: only one timeseries
	   at the time. Maybe useful for identifying datasets and
	   their hierarchy
:Bulk Download: xls, csv, or structured text
:Account: No

Desired datasets
================

:Description: From top level
   - Business, Industry and Services:
     everything except IT and internet industry
   - Economy: everything
   - Employment and labour market: everyhting
   - People, population and community:
     - Births, deaths and marrage:
       - Deaths
	 - Deaths registration summary tables
       - Live Births
	 - Birth summary tables: England and Wales
     - Housing
     - Personal and household finance
       - Income and wealth
	 - Nowcasting household income in the UK
     - Population and migration
       - International migration
	 - Provisional long-term migration estimates
	 - Short term international migration 01
:Remark: an Excel file contains several datasets, one per sheet. Use
	 the file name as a category code and file title as category name
:Note: the databases seem to be in CSV files, while tables extracted
       from publications are Excel files.
:Selection: we download only CSV files
:Note: All CSV files are on the same model	    
	 
Data tree
=========

:Existence of a hierachy of datasets on web site: yes
:How to recover the information:  parse html pages or https://api.ons.gov.uk/dataset 
:Branches: keep a tree branch only if it ends up in a CSV file
				  
Datasets
========

:datasetCode: CSV filename (without .csv)
:how to get release date: Row 5
:dataset docHref: yes HTML page
:dataset notes: no
:dimension_list: "unit" (merge Row 3 and Row 4), the list is to be
		 built while reading series
:use of attributes: ?
:attribute_list: ?
:available frequencies: A, Q, M
:availability of previous updates: no
:existence of real time datasets: no
			
Series
======

:Series key: Row 2
:Series name: Row 1
:Series docHref: no
:Series notes: Row 7
:missing values: ?
:date format: yyyy, yyyy Qq yyyy Mm
:mixed frequencies in the same dataset: yes

Updates
=======

:calendar of future updates:
   https://www.ons.gov.uk/releasecalendar?view=upcoming + the date of
   future release appears on Row 6 of a CSV file
:summary of previous upudates: https://www.ons.gov.uk/releasecalendar
:regular updates: no
:RSS flow: feed://www.ons.gov.uk/releasecalendar?rss&view=upcoming
:best way to monitor updates: parse calendar
		     
Special problems
================


Other remarks
=============