Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • M management
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 183
    • Issues 183
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • dbnomics-fetchers
  • management
  • Wiki
  • Fetcher description
  • ons

Last edited by Michel Juillard Oct 09, 2017
Page history

ons

ons

Provider

provider_name: ONS
provider_longname: Office for National Statistics
provider URL: http://ons.gov.uk
region: UK
terms of use: https://www.ons.gov.uk/help/termsandconditions
approximate number of datasets: > 3000

Data accessibility

SDMX: no
REST API: https://developer.ons.gov.uk/ Unusable for data: only one timeseries at the time. Maybe useful for identifying datasets and their hierarchy
Bulk Download: xls, csv, or structured text
Account: No

Desired datasets

Description:

From top level - Business, Industry and Services:

everything except IT and internet industry

  • Economy: everything

  • Employment and labour market: everyhting

  • People, population and community: - Births, deaths and marrage:

    • Deaths - Deaths registration summary tables
    • Live Births - Birth summary tables: England and Wales
    • Housing

    • Personal and household finance - Income and wealth

      • Nowcasting household income in the UK
    • Population and migration - International migration

      • Provisional long-term migration estimates
      • Short term international migration 01
Remark:

an Excel file contains several datasets, one per sheet. Use the file name as a category code and file title as category name

Note:

the databases seem to be in CSV files, while tables extracted from publications are Excel files.

Selection:

we download only CSV files

Note:

All CSV files are on the same model

Data tree

Existence of a hierachy of datasets on web site: yes
How to recover the information: parse html pages or https://api.ons.gov.uk/dataset
Branches: keep a tree branch only if it ends up in a CSV file

Datasets

datasetCode: CSV filename (without .csv)
how to get release date: Row 5
dataset docHref: yes HTML page
dataset notes: no
dimension_list: "unit" (merge Row 3 and Row 4), the list is to be built while reading series
use of attributes: ?
attribute_list: ?
available frequencies: A, Q, M
availability of previous updates: no
existence of real time datasets: no

Series

Series key: Row 2
Series name: Row 1
Series docHref: no
Series notes: Row 7
missing values: ?
date format: yyyy, yyyy Qq yyyy Mm
mixed frequencies in the same dataset: yes

Updates

calendar of future updates: https://www.ons.gov.uk/releasecalendar?view=upcoming + the date of future release appears on Row 6 of a CSV file
summary of previous upudates: https://www.ons.gov.uk/releasecalendar
regular updates: no
RSS flow: feed://www.ons.gov.uk/releasecalendar?rss&view=upcoming
best way to monitor updates: parse calendar

Special problems

Other remarks

Clone repository
  • 17 11 07
  • ClientNotes
  • Fetcher Description
    • AFDB
    • BCB
    • BCEAO
    • BEA
    • BI
    • BIS
    • BLS
    • BOJ
    • BUBA
    • CBO
    • CEPII
    • FHFA
    • GGDC
View All Pages