dendrite-python-sdk icon indicating copy to clipboard operation
dendrite-python-sdk copied to clipboard

How to handle pagination?

Open tylerdurden4285 opened this issue 10 months ago • 0 comments
trafficstars

I'm using dendrite to scrape data from a website and it has pagination. I searched the docs for it but found nothing.

How do you deal with pagination and also "endless scroll" websites for ensuring that all is scraped successfully and not just page 1?

tylerdurden4285 avatar Jan 09 '25 07:01 tylerdurden4285