Hayden icon indicating copy to clipboard operation
Hayden copied to clipboard

Minimum post age for scraper

Open b3lrog opened this issue 9 months ago • 2 comments

A feature I'd like is a configurable minimum age threshold that posts have to surpass before being archived. Setting this to something like 6 hours would essentially remove the need to manually moderate an archive since it gives jannies enough time to delete illegal content before it's archived.

b3lrog avatar May 04 '24 12:05 b3lrog

So there's going to be two parts to this:

  • Ignoring posts that are newer than a set configurable age
  • Adding capability for the board scanner to recheck threads that may contain posts older than set configurable age (Otherwise posts will be ignored until the next time the thread gets bumped)

First part should be really easy, second part would be pretty hard. It's possible to just make the first part but it's possible for posts to slip through the gaps. Depends on how much you care

bbepis avatar May 04 '24 17:05 bbepis

Yeah, I realised this when I took a look at implementing it myself. Having it only apply to threads would be easy to implement and wouldn't miss any posts but has the obvious downside of still archiving replies immediately.

b3lrog avatar May 05 '24 13:05 b3lrog