Matthieu Larcher
Matthieu Larcher
@dcts it's @SKreutz who said "Scraping offers by scrolling also works fine for me" not me... I just tested the 6.0.2 version, I got `[{"foundOffersCount":412,"stats":{"totalOffers":413}}]` so one offer is still...
second run got me `[{"foundOffersCount":405,"stats":{"totalOffers":413}}]` so we're not good yet :/
also, is there any chance it works on GCP with current version, or is it an unrelated problem that I get empty results in production ?
here it is @dcts : > server_1 | Scraping Opensea URL: https://opensea.io/collection/chumbivalleyofficial?search[sortAscending]=true&search[sortBy]=PRICE&search[toggles][0]=BUY_NOW
@dcts thanks for the information. GCP is not at stake here, as we have absolutely no result at all there (even if it used to work at some point before)....
> So yes theres still an issue. But can you confirm that you at least get the algorithm running and you get most of the offers? (even if its not...
perhaps you could use something like https://developer.mozilla.org/fr/docs/Web/API/MutationObserver to monitor dom changes, scroll, and debounce an ending function until nothing moves anymore ?
@dcts hooking into the graphql API sounds like a wonderful idea. It could drastically improve the performance and avoid some DOM related pitfalls 👍
> Side note: At that point it might be worth trying to use the opensea graphQL api but I never could make it work and I heard from people that...
any idea if/when this will get merged ?