dig-etl-engine icon indicating copy to clipboard operation
dig-etl-engine copied to clipboard

Duplication of desired_docs field in status.json

Open elmaestro08 opened this issue 7 years ago • 0 comments

Datasets with identifiers containing upper case letters are being duplicated in the status.json file contained in the working_dir of the project. This is causing the desired flag in the DIG UI to be reset to zero. Hence, the data is not ingested into the system.

Example status.json:

{ "desired_docs": { "imfCPI": 0, "imfcpi": 1 }, "added_docs": { "imfCPI": 0 }, "total_docs": { "imfCPI": 1 } }

elmaestro08 avatar Oct 20 '18 00:10 elmaestro08