Christian Parker

I am adding these plots just for reference  This is a plot of the number of locations that exist in a file as a function of how long the...

Great list. I am checking each of them against the lambda branch and then will make a new issue for each so that they can be fixed and/or closed individually.

Australia - South Australia Added issue #918

Australia - Victoria Working on the lambda branch ```bash node index.js -e .env -ds 'Australia - Victoria' {"level":"info","message":"--- Dry run for Testing, nothing is saved to the database. ---"} {"level":"info","message":"Looking...

Bosnia_Tuzlanski Issue #919

We would likely want to look deeper into the cost but based on my quick look it comes down to this A typical file from Japan is about 350K (which...

@majesticio (from #917 ) I could be wrong but I dont think this was ever the issue. The `timeLastInserted` value that is used in the filter mentioned above is derived...

The issue is in the fetcher, not the ingestion. The fetcher is not even fetching data to pass to the ingester.

I suggest that we set it up to pass an actual value for the `timeLastInserted` which could be maintained in the db for each provider and/or source. And then we...

I did some refactoring and after playing with it for a while I think I would agree that we dont need puppeteer. For example, this url https://www.dpccairdata.com/dpccairdata/display/AallAdvanceSearchCconc.php?stName=TWFuZGlybWFyZw== with this payload...