rest-data-connector icon indicating copy to clipboard operation
rest-data-connector copied to clipboard

Published 20 hours ago • verified publisher icon niranjan94

Data does not update when extract is refreshed

Open quack3d opened this issue 3 years ago • 4 comments

Shouldn't data be updated when extract is refreshed?

If I connect to the WDC with GET and https://qrng.anu.edu.au/API/jsonI.php?length=1&type=uint8 I get a random number in the data variable.

But when I refresh the extract in Tableau Desktop the data variable is not updated.

quack3d avatar Aug 30 '21 07:08 quack3d

Is this abandoned?

quack3d avatar Sep 27 '21 06:09 quack3d

+1 on this issue

dfeinzeig avatar Sep 29 '21 19:09 dfeinzeig

@niranjan94 Have you had a chance to look at this?

quack3d avatar Oct 26 '21 11:10 quack3d

Hi @sepodele. I took a look into this today.

  1. Currently RDC does the data loading outside of the connector's getData inside the respective components powering the REST-API/Swagger/OpenAPI interfaces.
  2. This is done to make the Export Data UI possible allowing you to customize the data before import into Tableau
  3. But the downside of this approach is, since the actual request is done only once, any other future calls to getData return the stale data. And the Refresh button inside Tableau calls this function
  4. Moving the network request login into getData is going to take a fair amount of effort as even getSchema needs the data before hand to generate a schema from the data.

Unfortunately, I don't have the bandwidth at the moment to make changes of this level. And can't commit to a specific timeline for this either. But if anyone is willing to take a stab and it and contribute a PR, I'm more than happy to review it and give my comments until it is merge-able.

niranjan94 avatar Oct 28 '21 12:10 niranjan94