dig-etl-engine
dig-etl-engine copied to clipboard
Duplication of desired_docs field in status.json
Datasets with identifiers containing upper case letters are being duplicated in the status.json file contained in the working_dir of the project. This is causing the desired flag in the DIG UI to be reset to zero. Hence, the data is not ingested into the system.
Example status.json:
{ "desired_docs": { "imfCPI": 0, "imfcpi": 1 }, "added_docs": { "imfCPI": 0 }, "total_docs": { "imfCPI": 1 } }