|
|
# STATCAN
|
|
|
|
|
|
## Provider
|
|
|
|
|
|
* **provider_name**: STATCAN
|
|
|
* **provider_longname**: Statistics Canada
|
|
|
* **provider URL**: https://www.statcan.gc.ca
|
|
|
* **region**: CA
|
|
|
* **terms of use**: https://www.statcan.gc.ca/eng/reference/important-notices
|
|
|
* **approximate number of datasets**: 7000
|
|
|
|
|
|
|
|
|
## Data accessibility
|
|
|
|
|
|
* **SDMX: (If yes, links and SDMX releases implemented**: ML 2.0, ML 2.1, JSON 2.1)
|
|
|
* **REST API**: https://www.statcan.gc.ca/eng/developers/wds/user-guide, https://www150.statcan.gc.ca/t1/wds/rest/
|
|
|
* **Bulk Download: No
|
|
|
* **Account**: No
|
|
|
|
|
|
## Desired datasets
|
|
|
|
|
|
* **Description**: For the time being, all Economic accounts and Latest (not archived). This is about 202 datasets.
|
|
|
|
|
|
## Data tree
|
|
|
|
|
|
* **Existence of a hierachy of datasets on web site**: https://www150.statcan.gc.ca/n1/en/type/data?MM=1
|
|
|
* **How to recover the information**:
|
|
|
|
|
|
## Data download
|
|
|
- the list of tables can't be downloaded automatically because of JavaScript code
|
|
|
- the list of desired datasets (tables on Statistics Canada website) have been colected partly manually see code at https://git.nomics.world/MichelJuillard/statcan
|
|
|
- see the list of table codes at the end of this file
|
|
|
- A table needs to be downloaded in two steps:
|
|
|
```
|
|
|
response1 = requests.get("https://www150.statcan.gc.ca/t1/wds/rest/getFullTableDownloadCSV/DATASET_CODE/en")
|
|
|
json = response1.json()
|
|
|
response2 = requests.get(json['object'])
|
|
|
```
|
|
|
where ``DATASET_CODE`` is taken in the list
|
|
|
- The table can be downloaded in CSV or in SDMX format. For SDMX
|
|
|
```
|
|
|
https://www150.statcan.gc.ca/t1/wds/rest/getFullTableDownloadSDMX/DATASET_CODE
|
|
|
```
|
|
|
## Datasets
|
|
|
|
|
|
* **datasetCode**: provided
|
|
|
* **how to get release date**: only on the web site
|
|
|
* **dataset docHref**: no
|
|
|
* **dataset notes**: yes on the web site
|
|
|
* **dimension_list**: yes in metadata file
|
|
|
* **use of attributes**: yes
|
|
|
* **attribute_list**: to be made up
|
|
|
* **available frequencies**: Y, Q, M
|
|
|
* **availability of previous updates**: No
|
|
|
* **existence of real time datasets**: yes, some indicated in the dataset name
|
|
|
|
|
|
## Series
|
|
|
|
|
|
* **Series key**: use "vector" in data file
|
|
|
* **Series name**: must be made up from non scalar dimensions
|
|
|
* **Series docHref**: no
|
|
|
* **Series notes**: yes
|
|
|
* **missing values**: .., ..., x (see metadata file)
|
|
|
* **date format**: yyyy-mm,
|
|
|
* **mixed frequencies in the same dataset**: no
|
|
|
|
|
|
## Updates
|
|
|
|
|
|
* **calendar of future updates**: REST service with list of tables updated the current day
|
|
|
* **summary of previous updates**: no
|
|
|
* **regular updates**: daily
|
|
|
* **RSS flow**: https://www.canada.ca/en/news/web-feeds.html
|
|
|
* **best way to monitor updates**:
|
|
|
|
|
|
## Special problems
|
|
|
|
|
|
- A list of all available tables doesn't seem to exist
|
|
|
- Crawling the list of the web site requires to run a JavaScript app
|
|
|
- The current list of tables has been downloaded manually
|
|
|
|
|
|
## Other remarks
|
|
|
|
|
|
## Data samples
|
|
|
* **location**: in test_xxx file or light files in dlstats/dlstats/tests/resources
|
|
|
* **description**: a very brief description of the data samples
|
|
|
|
|
|
## List of desired dataset codes
|
|
|
36100028
|
|
|
36100029
|
|
|
36100030
|
|
|
36100031
|
|
|
36100032
|
|
|
36100033
|
|
|
36100034
|
|
|
36100035
|
|
|
36100444
|
|
|
36100475
|
|
|
36100486
|
|
|
36100583
|
|
|
36100584
|
|
|
38100010
|
|
|
38100250
|
|
|
36100434
|
|
|
36100434
|
|
|
36100434
|
|
|
36100434
|
|
|
36100434
|
|
|
36100434
|
|
|
36100230
|
|
|
36100230
|
|
|
36100231
|
|
|
36100231
|
|
|
36100232
|
|
|
36100233
|
|
|
36100234
|
|
|
36100234
|
|
|
36100235
|
|
|
36100456
|
|
|
36100458
|
|
|
36100459
|
|
|
36100460
|
|
|
36100490
|
|
|
38100285
|
|
|
10100015
|
|
|
36100452
|
|
|
36100453
|
|
|
36100448
|
|
|
36100467
|
|
|
36100578
|
|
|
36100579
|
|
|
36100580
|
|
|
38100234
|
|
|
38100235
|
|
|
38100236
|
|
|
38100237
|
|
|
38100238
|
|
|
36100039
|
|
|
36100412
|
|
|
36100443
|
|
|
36100446
|
|
|
36100454
|
|
|
36100469
|
|
|
36100485
|
|
|
36100581
|
|
|
36100042
|
|
|
36100430
|
|
|
36100431
|
|
|
16100109
|
|
|
36100206
|
|
|
36100207
|
|
|
10100002
|
|
|
10100133
|
|
|
36100103
|
|
|
36100104
|
|
|
36100105
|
|
|
36100106
|
|
|
36100107
|
|
|
36100108
|
|
|
36100109
|
|
|
36100110
|
|
|
36100111
|
|
|
36100112
|
|
|
36100114
|
|
|
36100115
|
|
|
36100116
|
|
|
36100117
|
|
|
36100118
|
|
|
36100121
|
|
|
36100122
|
|
|
36100123
|
|
|
36100124
|
|
|
36100125
|
|
|
36100126
|
|
|
36100127
|
|
|
36100128
|
|
|
36100129
|
|
|
36100130
|
|
|
36100131
|
|
|
36100132
|
|
|
36100133
|
|
|
36100135
|
|
|
36100205
|
|
|
36100369
|
|
|
36100477
|
|
|
36100484
|
|
|
36100002
|
|
|
36100003
|
|
|
36100014
|
|
|
36100016
|
|
|
36100018
|
|
|
36100019
|
|
|
36100020
|
|
|
36100021
|
|
|
36100023
|
|
|
36100024
|
|
|
36100025
|
|
|
36100026
|
|
|
36100027
|
|
|
36100442
|
|
|
36100471
|
|
|
36100472
|
|
|
36100480
|
|
|
36100489
|
|
|
36100489
|
|
|
36100489
|
|
|
36100489
|
|
|
36100489
|
|
|
36100489
|
|
|
10100012
|
|
|
36100008
|
|
|
36100009
|
|
|
36100101
|
|
|
36100585
|
|
|
36100586
|
|
|
36100587
|
|
|
36100588
|
|
|
36100589
|
|
|
36100590
|
|
|
36100366
|
|
|
36100370
|
|
|
36100371
|
|
|
36100411
|
|
|
36100001
|
|
|
36100084
|
|
|
36100208
|
|
|
36100217
|
|
|
34100166
|
|
|
38100006
|
|
|
38100007
|
|
|
10100005
|
|
|
10100024
|
|
|
36100576
|
|
|
36100577
|
|
|
38100096
|
|
|
38100098
|
|
|
36100038
|
|
|
36100372
|
|
|
36100474
|
|
|
10100016
|
|
|
10100022
|
|
|
10100023
|
|
|
10100147
|
|
|
36100440
|
|
|
36100445
|
|
|
36100447
|
|
|
36100451
|
|
|
36100470
|
|
|
36100582
|
|
|
36100096
|
|
|
36100097
|
|
|
36100098
|
|
|
36100099
|
|
|
12100088
|
|
|
34100095
|
|
|
36100221
|
|
|
36100222
|
|
|
36100223
|
|
|
36100224
|
|
|
36100225
|
|
|
36100226
|
|
|
36100401
|
|
|
36100432
|
|
|
36100438
|
|
|
36100450
|
|
|
36100478
|
|
|
36100479
|
|
|
36100481
|
|
|
36100482
|
|
|
36100487
|
|
|
36100488
|
|
|
36100004
|
|
|
36100005
|
|
|
36100006
|
|
|
36100007
|
|
|
36100022
|
|
|
36100212
|
|
|
12100100
|
|
|
36100461
|
|
|
36100462
|
|
|
36100463
|
|
|
36100464
|
|
|
36100465
|
|
|
37100068
|
|
|
36100468
|
|
|
36100229
|
|
|
36100209
|
|
|
36100210
|
|
|
36100213
|
|
|
38100029
|
|
|
|