scrapyrt icon indicating copy to clipboard operation
scrapyrt copied to clipboard

can scrapyrt be used to schedule scrapes?

Open doverradio opened this issue 1 year ago • 1 comments

I am using scrapyrt extensively by just sending requests from another server where that other server has been using crontab.

However, I began wondering if I could just set scrapyrt to a schedule instead of having to fire all these requests.

This github repo states "It starts HTTP server allowing you to schedule spiders and get spider output in JSON."

However, that's the only mention of "schedule spiders".

Is there a way?

doverradio avatar Jan 30 '23 07:01 doverradio