... | ... | @@ -12,18 +12,28 @@ |
|
|
|
|
|
* **SDMX**: No
|
|
|
* **REST API**: yes
|
|
|
* **Bulk Download**: yes,
|
|
|
* **Bulk Download**: yes, https://download.bls.gov/pub/time.series/
|
|
|
* **Account**: No
|
|
|
|
|
|
## Desired datasets
|
|
|
|
|
|
We want the datasets listed as "Test Files" in
|
|
|
https://www.bls.gov/data/#historical-tables and corresponding to the
|
|
|
following dataset_codes (and directories in the bulkdown area)
|
|
|
|
|
|
* **dataset_codes:** "ap", "bd", "ce", "ci", "cm", "cu", "cw", "cx",
|
|
|
"eb", "ei", "fm", "ip", "is", "jt", "la", "le", "ln", "lu", "mp",
|
|
|
"nb", "or", "pc", "pr", "sm", "su", "tu", "wm", "wp", "ws"
|
|
|
|
|
|
## Omitted datasets
|
|
|
|
|
|
* **dataset_codes:** "cs", "fw", "oe"
|
|
|
The following datasets are omitted because they are too big not very
|
|
|
relevant for macroeconomics
|
|
|
|
|
|
* **dataset_codes:**
|
|
|
- "cs": Nonfatal cases involving days away from work: selected characteristics
|
|
|
- "fw": Census of fatal occupational injuried
|
|
|
- "oe": Employment and Wages from Occupational Employment Statistics (OES) survey
|
|
|
|
|
|
|
|
|
* **Description**:
|
... | ... | @@ -46,11 +56,11 @@ |
|
|
## Datasets
|
|
|
|
|
|
* **how to get release date**: date of the file
|
|
|
* **dataset docHref**: yes see bly.py line 162
|
|
|
* **dataset notes**: yes
|
|
|
* **dataset docHref**: yes see bls.py line 162
|
|
|
* **dataset notes**: yes see bls.py line 136
|
|
|
* **dimension_list**: to be made from the series
|
|
|
* **use of attributes**: maybe
|
|
|
* **attribute_list**: footnote
|
|
|
* **use of attributes**: yes, bls.py line 303
|
|
|
* **attribute_list**: file \*footnote\*
|
|
|
* **available frequencies**: A Q S M B
|
|
|
* **availability of previous updates**: no
|
|
|
* **existence of real time datasets**: no
|
... | ... | @@ -63,6 +73,7 @@ |
|
|
* **Series notes**: series footnote
|
|
|
* **missing values**: missing observations absent from the data file
|
|
|
* **date format**: year subperiod
|
|
|
* **strange conventions**: Q5 and M13 are annual average!
|
|
|
* **mixed frequencies in the same dataset**: yes
|
|
|
|
|
|
## Updates
|
... | ... | @@ -129,21 +140,29 @@ Work Experience of the Population (Annual) |
|
|
## Special problems
|
|
|
|
|
|
- annual averages are provided in extra period code (M13, S03),
|
|
|
intervined in regular periods
|
|
|
- periods are not consecutive in the earlier part of some datasets
|
|
|
intervined in regular periods. See bls.py lines 79, 365, 396, 847, 854
|
|
|
- periods are not consecutive in the earlier part of some
|
|
|
datasets. See function fill_series(), bls.py line 332, used lines
|
|
|
446 and 459. This treatment isn't conform with the new
|
|
|
infrastructure where the convention is to leave holes in the time
|
|
|
series as in the original data
|
|
|
- data for one dataset are distributed among several data files. Some
|
|
|
dataseries are present in several data files
|
|
|
dataseries are present in several data files:
|
|
|
- files with name xx.data.0.Current contains only recent data
|
|
|
- it is necessary to look in all the data files because some series
|
|
|
are only present in xx.data.0.Current
|
|
|
- see bls.py line 519
|
|
|
- some dimensions don't have code file (base_period, base_year,
|
|
|
base_date, benchmark_year, seasonal)
|
|
|
base_date, benchmark_year, seasonal). See bls.py line 588
|
|
|
- dimension periodicity doesn't indicate frequency of observation but
|
|
|
rather the time span of the observation
|
|
|
- Import/Export price indexes: country of origin hidden in series key
|
|
|
without code list
|
|
|
- several attributes may appear comma separated for one observation
|
|
|
- some code files contain two codes.
|
|
|
without code list. Can't find a treatment in bls.py
|
|
|
- several attributes may appear comma separated for one
|
|
|
observation. See bls.py line 319
|
|
|
- some code files contain two codes. See bls.py line 587
|
|
|
- dataset "pc": *footnote* instead of *footnote_codes* as in other
|
|
|
datasets (bls.pyl line 286)
|
|
|
|
|
|
## Other remarks
|
|
|
|
... | ... | |