|
|
===============
|
|
|
ons
|
|
|
===============
|
|
|
|
|
|
Provider
|
|
|
========
|
|
|
|
|
|
:provider_name: ONS
|
|
|
:provider_longname: Office for National Statistics
|
|
|
:provider URL: http://ons.gov.uk
|
|
|
:region: UK
|
|
|
:terms of use: https://www.ons.gov.uk/help/termsandconditions
|
|
|
:approximate number of datasets: > 3000
|
|
|
|
|
|
|
|
|
Data accessibility
|
|
|
==================
|
|
|
|
|
|
:SDMX: no
|
|
|
:REST API: https://developer.ons.gov.uk/ Unusable for data: only one timeseries
|
|
|
at the time. Maybe useful for identifying datasets and
|
|
|
their hierarchy
|
|
|
:Bulk Download: xls, csv, or structured text
|
|
|
:Account: No
|
|
|
|
|
|
Desired datasets
|
|
|
================
|
|
|
|
|
|
:Description: From top level
|
|
|
- Business, Industry and Services:
|
|
|
everything except IT and internet industry
|
|
|
- Economy: everything
|
|
|
- Employment and labour market: everyhting
|
|
|
- People, population and community:
|
|
|
- Births, deaths and marrage:
|
|
|
- Deaths
|
|
|
- Deaths registration summary tables
|
|
|
- Live Births
|
|
|
- Birth summary tables: England and Wales
|
|
|
- Housing
|
|
|
- Personal and household finance
|
|
|
- Income and wealth
|
|
|
- Nowcasting household income in the UK
|
|
|
- Population and migration
|
|
|
- International migration
|
|
|
- Provisional long-term migration estimates
|
|
|
- Short term international migration 01
|
|
|
:Remark: an Excel file contains several datasets, one per sheet. Use
|
|
|
the file name as a category code and file title as category name
|
|
|
|
|
|
Data tree
|
|
|
=========
|
|
|
|
|
|
:Existence of a hierachy of datasets on web site: yes
|
|
|
:How to recover the information: parse html pages or https://api.ons.gov.uk/dataset
|
|
|
|
|
|
Datasets
|
|
|
========
|
|
|
|
|
|
:datasetCode: provided (filename + sheet name)
|
|
|
:how to get release date: Excel file properties (Modified)
|
|
|
:dataset docHref: yes
|
|
|
:dataset notes: yes
|
|
|
:dimension_list: to be deducted from spreadsheet
|
|
|
:use of attributes: yes
|
|
|
:attribute_list: provided at the bottom of the spreadsheet
|
|
|
:available frequencies: ?
|
|
|
:availability of previous updates: sometimes. See when parsing
|
|
|
category html pages
|
|
|
:existence of real time datasets: no
|
|
|
|
|
|
Series
|
|
|
======
|
|
|
|
|
|
:Series key: to be make up (rowXX or colXX ?)
|
|
|
:Series name: provided
|
|
|
:Series docHref: no
|
|
|
:Series notes: yes
|
|
|
:missing values: ?
|
|
|
:date format: various
|
|
|
:mixed frequencies in the same dataset: yes
|
|
|
|
|
|
Updates
|
|
|
=======
|
|
|
|
|
|
:calendar of future updates: https://www.ons.gov.uk/releasecalendar?view=upcoming
|
|
|
:summary of previous upudates: https://www.ons.gov.uk/releasecalendar
|
|
|
:regular updates: no
|
|
|
:RSS flow: feed://www.ons.gov.uk/releasecalendar?rss&view=upcoming
|
|
|
:best way to monitor updates: parse calendar
|
|
|
|
|
|
Special problems
|
|
|
================
|
|
|
|
|
|
|
|
|
Other remarks
|
|
|
=============
|
|
|
|
|
|
- see whether it is possile to factorize parsing the Excel files.
|
|
|
- if not, we will need to diminish the number of downloaded files
|
|
|
|
|
|
|
|
|
|
|
|
|