changedetection.io icon indicating copy to clipboard operation
changedetection.io copied to clipboard

[feature] Scroll functionality to fetch the full page with lazy loading

Open marcusique opened this issue 2 years ago • 1 comments

Version and OS v0.39.9; linux/arm; docker

Is your feature request related to a problem? Please describe. Yes. I have a shopping list on Amazon and I can't preload all items unless I scroll to the very bottom of the page (it defaults to 10 items at initial page load). When the viewport is at the bottom of those 10 items, the page preloads the next 10 items and so on.

Describe the solution you'd like It would be great to have this functionality built-in (not sure how though since it would probably require a webdriver to do so). I have chromium-webdriver installed and I can use it as a fetch method, but it's not configurable, i.e. I can't make it scroll the page to the bottom and then fetch HTML. As far as I know Amazon closed the API that would allow to fetch items from the shopping list as JSON, so parsing is the only option.

Describe the use-case and give concrete real-world examples Here's an example of a shopping list with more than 10 items on it – https://www.amazon.de/hz/wishlist/ls/391ATAAAAS6JL?ref_=wl_share

Additional context N/A

marcusique avatar Mar 10 '22 11:03 marcusique

https://github.com/dgtlmoon/changedetection.io/pull/478

dgtlmoon avatar Mar 20 '22 10:03 dgtlmoon