morph icon indicating copy to clipboard operation
morph copied to clipboard

Expose queue status on running scrapers page

Open henare opened this issue 9 years ago • 1 comments

We should split https://morph.io/scrapers/running into Active (currently running on Sidekiq), Enqueued (enqueued on Sidekiq), and Dead (scraper status is running but not on the queue).

We've just added a view similar to this on the admin dashboard. It would be good for people to be able to see it.

henare avatar Apr 30 '16 06:04 henare

I guess there's two things going on here:

  1. If we're having to provide visibility to people about how something isn't working, why are we not putting our effort into fixing the problem rather than showing them a different way that "yes, something has gone wrong and morph.io sucks"
  2. If we do want to provide this kind of visibility don't we really want to do it at the level of the scraper rather than the platform. From the user point of view, they're asking "why isn't my scraper working?" rather than "I wonder how the morph.io platform is behaving". The second question is really something that we, as platform developers and maintainers, are interested in.

mlandauer avatar Jul 01 '16 00:07 mlandauer