Merging a dataset in TSV produces JSON-Lines
See also: #996
Description
ISM is still storing *.tsv
files and it has dataset_update_strategy=merge
Data are stored in *.tsv
files until 05/2021 and later in a *.jsonl
file
Tasks
-
fix bug with _get_storage_variant
-
delete jsonl files manually -
run the fetcher again and check data stays in TSV
Edited by Michel Juillard