Commits · ad73429a1d0e05d6fbcca55e0a795903722d198d · dbnomics-fetchers / eurostat-fetcher · GitLab

Snippets Groups Projects

Nov 23, 2017
- Remove unused import · ad73429a
  Christophe Benz authored 7 years ago
  
  ad73429a
- Follow data model evolutions: remove provider name, which is redundant · e7c730ba
  Christophe Benz authored 7 years ago
  
  e7c730ba
- Follow data model evolution: provider has no more slug · c4d6ca87
  Christophe Benz authored 7 years ago
  
  c4d6ca87
Nov 22, 2017
- Update dependencies · 87bb1bd0
  Christophe Benz authored 7 years ago
  
  87bb1bd0
- Remove branches in categories tree without datasets · e7fe93ab
  Christophe Benz authored 7 years ago
  
  e7fe93ab
- Keep branches in categories tree containing converted datasets · d46be73d
  Christophe Benz authored 7 years ago
  
  d46be73d
- Don't add "type" property to categories tree nodes... · 29e08305
  Christophe Benz authored 7 years ago
```
a dataset can be recognized because it has no children
```
  29e08305
- Fix index creation · 57482d2f
  Christophe Benz authored 7 years ago
  
  57482d2f
- Log index creation · 88ae9300
  Christophe Benz authored 7 years ago
  
  88ae9300
- Do not use f-strings, prod has Python < 3.6 · 5aa9b5f0
  Christophe Benz authored 7 years ago
  
  5aa9b5f0
- Reduce number of Git objects written in pack and... · 4f37193f
  Christophe Benz authored 7 years ago
```
- write categories_tree.json
- write datasets index
```
  4f37193f
- Store series in a list property of dataset.json · f5ca987b
  Christophe Benz authored 7 years ago
  
  f5ca987b
- Do not store empty keys in dataset.json · 39e6a083
  Christophe Benz authored 7 years ago
  
  39e6a083
- Do not create series sub-directories · 3a8e3cdd
  Christophe Benz authored 7 years ago
  
  3a8e3cdd
- Store dataset name, description and doc_href · 0d989033
  Christophe Benz authored 7 years ago
  
  0d989033
- Add debug info · 32f518fa
  Christophe Benz authored 7 years ago
  
  32f518fa
- If pack exists, and no source is found, add it anyway · 32397800
  Christophe Benz authored 7 years ago
  
  32397800
Nov 21, 2017
- Update to new index format · 220fb37e
  Christophe Benz authored 7 years ago
  
  220fb37e
- Index dataset.json blobs too · ab260156
  Christophe Benz authored 7 years ago
  
  ab260156
- Import categories tree · 66edc75e
  Christophe Benz authored 7 years ago
  
  66edc75e
Nov 20, 2017
- Use git CLI to generate packs info file · 34df5607
  Christophe Benz authored 7 years ago
  
  34df5607
- Add cwd to subprocess · 2b71706c
  Christophe Benz authored 7 years ago
  
  2b71706c
- Reimplement update_server_info to avoid error · cf516c22
  Christophe Benz authored 7 years ago
  
  cf516c22
- Use line based index · 842fe5ca
  Christophe Benz authored 7 years ago
  
  842fe5ca
- Use "git" CLI to bypass dulwich error · af0190f6
  Christophe Benz authored 7 years ago
  
  af0190f6
Nov 19, 2017
- Add update_dataset_index.py script · 2d8b1e17
  Christophe Benz authored 7 years ago
  
  2d8b1e17
- Implement incremental option for fetcher · 1bc39013
  Christophe Benz authored 7 years ago
  
  1bc39013
- Close packs to avoid "too many files open" error · cb69dd4b
  Christophe Benz authored 7 years ago
  
  cb69dd4b
- Improve comment · 8b257833
  Christophe Benz authored 7 years ago
  
  8b257833
Nov 17, 2017
- Add --no-commit option · 3acce9ba
  Christophe Benz authored 7 years ago
  
  3acce9ba
- Find existing dataset tree in packs instead of commit · a97ab709
  Christophe Benz authored 7 years ago
  
  a97ab709
- Add --keep-packs and --datasets-codes options · 60183894
  Christophe Benz authored 7 years ago
  
  60183894
Nov 16, 2017
- Implement "append" mode for pack files, fix SHA-1 checksum. · 6977e67e
  Christophe Benz authored 7 years ago
  
  6977e67e
- Optimize lxml iterparse memory consumption · 4b08c648
  Christophe Benz authored 7 years ago
  
  4b08c648
- Ignore ujson pylint errors · d331439a
  Christophe Benz authored 7 years ago
  
  d331439a
- Add file size and time indicators · a37dc46e
  Christophe Benz authored 7 years ago
  
  a37dc46e
- Simplify object pairs iteration · b93eecf2
  Christophe Benz authored 7 years ago
  
  b93eecf2
- Use ujson module as a drop-in replacement of json · cd066d53
  Christophe Benz authored 7 years ago
  
  cd066d53
- Optimize the SHA creation · a7d2df2c
  Christophe Benz authored 7 years ago
  
  a7d2df2c
Nov 15, 2017
- Display absolute path · 642067ea
  Christophe Benz authored 7 years ago
  
  642067ea