... | @@ -73,7 +73,7 @@ relevant for macroeconomics |
... | @@ -73,7 +73,7 @@ relevant for macroeconomics |
|
* **Series notes**: series footnote
|
|
* **Series notes**: series footnote
|
|
* **missing values**: missing observations absent from the data file
|
|
* **missing values**: missing observations absent from the data file
|
|
* **date format**: year subperiod
|
|
* **date format**: year subperiod
|
|
* **strange conventions**: Q5 and M13 are annual average!
|
|
* **strange conventions**: S3, Q5 and M13 are annual average!
|
|
* **mixed frequencies in the same dataset**: yes
|
|
* **mixed frequencies in the same dataset**: yes
|
|
|
|
|
|
## Updates
|
|
## Updates
|
... | @@ -195,15 +195,27 @@ Work Experience of the Population (Annual) |
... | @@ -195,15 +195,27 @@ Work Experience of the Population (Annual) |
|
- using header of \*series file, get dimension names with
|
|
- using header of \*series file, get dimension names with
|
|
get_dimensions_keys(), line 576
|
|
get_dimensions_keys(), line 576
|
|
- download dimension files with get_code_list(), line 582, that
|
|
- download dimension files with get_code_list(), line 582, that
|
|
calls get_dimension_data(), line 652. This
|
|
calls get_dimension_data(), line 652.
|
|
|
|
- data file names are obtained with get_data_filenames(), line 683.
|
|
|
|
- data files are handled in iterator SeriesIterator, line 283.
|
|
|
|
- data files are downloaded line 293
|
|
|
|
|
|
|
|
5. Parsing of code dictionaries files
|
|
|
|
- function get_code_list(), line 582. This
|
|
function handles all peculiarities in the naming of the
|
|
function handles all peculiarities in the naming of the
|
|
dimensions and the format of the dictionary files:
|
|
dimensions and the format of the dictionary files:
|
|
- fmt = 1, two colonms, code - label
|
|
- fmt = 1, two colonms, code - label
|
|
- fmt = 2, three columns, ignore first column - code - label
|
|
- fmt = 2, three columns, ignore first column - code - label
|
|
- fmt = 3, double classification, code - secondary code - label
|
|
- fmt = 3, double classification, code - secondary code - label
|
|
- fmt = 4, double classification, code1 - code2 - ignore - label
|
|
- fmt = 4, double classification, code1 - code2 - ignore - label
|
|
- data file names are obtained with get_data_filenames(), line 683.
|
|
|
|
- data files are handled in iterator SeriesIterator, line 283.
|
|
6. Parsing of data files. We want all series listed in file \*.series. We
|
|
- data files are downloaded line 293
|
|
must read all \*data\* files in parallel. Done in iterator
|
|
|
|
SeriesIterator line 283.
|
|
TO BE CONTINUED.... |
|
|
|
|
|
7. Data of different frequencies are meshed in the \*data\* files in
|
|
|
|
some cases: annual (average) data are mixed with semestrial (S3),
|
|
|
|
quartely (Q5) or monthly (M13) data. In this case, the iterator
|
|
|
|
BlsData, function __next__(), line 826, returns two time series in
|
|
|
|
two different bsons
|
|
|
|
(one annual and the other semestrial, quarterly or monthly). |