organic-search-analytics icon indicating copy to clipboard operation
organic-search-analytics copied to clipboard

Data capture import for zero records days

Open sugarbeatsthat opened this issue 8 years ago • 3 comments

Hi,

If a website has zero records to import from Google Search Console for a particular day, the Data Capture page's "Import all non-imported data" button imports the data (zero records) successfully, but after a page refresh, the Data Capture page displays the data as "non-imported" again, prompting the user to import that record again.

imported

ready to import again

sugarbeatsthat avatar Nov 17 '16 03:11 sugarbeatsthat

Thank you for sharing this bug.

The way the tool works, it writes to a table all of the queries for a given day. If there are no queries in the table for that day, then it assumes it needs to run/capture for that day.

While that design does allow for this type of a situation to occur, it also has other benefits in that it's less overhead to maintain/update (not managing a table of days processed), and keeps the data simple and clean. Also, what if Google is down for a day (yes, this data from Google has been known to be imperfect) then it would know to re-check it at a future date.

That said, I'll need to continue to think on how to best work around this situation. I'm open to suggestions.

PromInc avatar Nov 17 '16 18:11 PromInc

Can you please fix this issue by adding 0 (or any other value you deem useful - e.g. string or adding another column to the DB "n/a" enum or boolean false possibly)?

It is slowing the import down when it needs to go over unretrieved data over and over again. Thanks

nekromoff avatar May 22 '17 15:05 nekromoff

Can you add a "date range" or a "from date field" for display and import date limit?

GitHub-Mike avatar Oct 06 '17 09:10 GitHub-Mike