bridgy icon indicating copy to clipboard operation
bridgy copied to clipboard

handle paging: fetch multiple pages of comments, likes, etc to backfeed

Open snarfed opened this issue 9 years ago • 3 comments

right now, we only backfeed the first page worth of comments, likes, etc that each API gives us. if there are more, we don't follow the "next page" links to fetch and backfeed them too. we should!

noticed in https://github.com/snarfed/bridgy/issues/502#issuecomment-210782298, #73, maybe elsewhere.

applies to most of the silos, if not all.

API docs:

snarfed avatar Apr 23 '16 22:04 snarfed

especially noticeable for reactions (#626), since FB always includes likes first in the reactions field, which we ignore since we handle them as normal likes. e.g. @dissolve has many missing FB reactions right now since his posts often get lots of likes.

snarfed avatar Apr 28 '16 20:04 snarfed

...hrm, that's not actually true after all. non-like reactions do show up before likes in reactions at least sometimes.

snarfed avatar Apr 28 '16 22:04 snarfed

the big saving grace here is that Facebook generally sorts responses descending, so the newest stuff is first, and we poll every 20-30m, so we only miss responses if more than 10-20 (per type) happen between polls.

nested comments are one exception, though. :/

snarfed avatar Apr 29 '16 00:04 snarfed