quant icon indicating copy to clipboard operation
quant copied to clipboard

DataProviders should have a common lifecycle

Open jdjkelly opened this issue 11 years ago • 1 comments

I want authenticated API sources flow through the Warden + Devise + Omniauth provider. They should have a common lifecycle.

On initial authentication, all historical data should be downloaded from the provider (if possible). Then, a synced_at attribute should be set with the current time stamp.

Data should be stored with any uniquely identifiable information from the API. This data should be indexed.

Subsequent requests should:

  • only request data after the synced_at date
  • use the stored ids as a uniqueness constraint
  • be performed without the need of scheduling (assuming they aren't web-hook style)

jdjkelly avatar Jan 17 '14 14:01 jdjkelly

Progress made in these PRs:

https://github.com/jdjkelly/quantify/pull/20 https://github.com/jdjkelly/quantify/pull/22

jdjkelly avatar Jan 24 '14 03:01 jdjkelly