Fix cloning big repositories
- As an external data operator
- I want to clone DBnomics Git repositories
- in order to work with DBnomics data.
Description
Currently GitLab offers a git clone
URL which does more computing than the standard Git HTTP server.
Acceptance criteria
-
DBnomics JSON data repositories MUST be cloneable, including the larger ones (Eurostat, CEPII) -
implement HTTP range headers with URLs like https://git.nomics.world/.dbnomics-json-data-static/ to use wget --continue
Resources
- GitLab issue (TODO find it)
Technical steps
- Setup a standard Git HTTP server alongside GitLab server, and communicate this URL to the users.