... | ... | @@ -79,15 +79,8 @@ Example: I open https://db.nomics.world/SCSMICH/MICS and it is "404 not found". |
|
|
- open http://localhost:8983/solr/dbnomics/query?q=type:dataset%20AND%20provider_code:SCSMICH%20AND%20code:MICS (the Solr query is more readable as `"type:dataset AND provider_code:SCSMICH AND code:MICS"`)
|
|
|
- if a JSON document is displayed, it's OK
|
|
|
- else
|
|
|
- before reindexing check that there is disk space on the server
|
|
|
- try to index in *full mode* (not incremental mode):
|
|
|
- `FULL_MODE=1 ./import_storage_dir.sh ~/json-data fetcher_slug`
|
|
|
- if it still doesn't work, you can have more verbose output by adding `bash -x` at the beginning of the line:
|
|
|
- `bash -x FULL_MODE=1 ./import_storage_dir.sh ~/json-data fetcher_slug`
|
|
|
- You'll see the two commands of indexation, that are actually piped. Example:
|
|
|
|
|
|
```
|
|
|
Adding JSON documents to Solr index corresponding to new or modified datasets or series...
|
|
|
+ /home/cepremap/dbnomics-importer/dbnomics_json_to_solr_jsonl.py --log=info /home/cepremap/json-data/statpol-json-data
|
|
|
+ /opt/solr/bin/post -c dbnomics -type application/json -url http://localhost:8983/solr/dbnomics/update/json/docs -
|
|
|
```
|
|
|
- try to launch `dbnomics_json_to_solr_jsonl.py | less` alone to see if there's any errors |
|
|
- open https://git.nomics.world/dbnomics/dbnomics-importer/pipelines/new
|
|
|
- fill the variables `PROVIDER_SLUG=SCSMICH` (replace by the one you want) and `FULL=1`
|
|
|
- click on "Run pipeline" |