Allow pipeline to reject jobs not targeted to it

[ivan]

Sometimes I need to start a custom pipeline for a specific website, but if there's stuff in the ArchiveBot queue, it fills up the pipeline with other crawls. Maybe this use case needs a --reject-untargeted-jobs option?

[hannahwhy]

Yeah, I've run into this use case before. Maybe --exclusive?

[ivan]

--vip very important pipeline, just kidding

[JustAnotherArchivist]

--pipeline takes precedence over jobs without that option, so queueing a job with that option using the name of the special pipeline you're about to start works for this.

It might still be useful though to run pipelines that don't accept jobs from the general pending queue but only jobs queued with --pipeline.