dlt
dlt copied to clipboard
RESTClient: stops pagination after empty page (Feat/1637)
Description
- Adds a new option to
RangePaginator
and its subclassesOffsetPaginator
andPageNumberPaginator
to stop pagination upon receiving a page without data items - By default, stops pagination after an empty page
- Every
RangePaginator
now requires eithertotal_path
ormaximum_offset
orstop_after_empty_page
- If
total_path
is not provided, pagination is controlled bymaximum_page
andstop_after_empty_page
ormaximum_offset
andstop_after_empty_page
respectively.
Related Issues
- Resolves #1637