tap-rest-api
tap-rest-api copied to clipboard
Pagination by unique keys
Some Rest API paginate with a dynamically generated next page URL/key included in the precedent response. We need to be able to identify such entry from the response and use it as the next call.
It also need to detect the end of the page and complete the sync.
One example is Crunchbase Search API https://data.crunchbase.com/docs/paginating-through-the-search-api