webrecorder
[Feature]: Sort by running in "Crawl workflows" + faster pagination
What change would you like to see?
It would be a great help to be able to sort so "running" was shown first. It would also be more effective with the pagelist also above the results, so scrolling wasn't needed. Possibly with the option to use arrowkeys for next and previous page.
Context
Having +40 pages it is a lot of work finding the 4 running jobs to manually check up on them.
Bump this up for better pagination, giving the user the ability to have 10, 25, 50 or 100 workflows per page would be terrific.
~~Slightly confused... Running workflows should always be sorted to the top if sorting by "Latest Crawl".~~
EDIT: Nope! They aren't.
Noted on the page list scrolling. Thanks for feedback. Some thoughts on how to solve that are available in #747
We may want to support additional sorting by workflow state ordered as running states -> waiting states -> failed -> success -> never, since "Latest Crawl" doesn't address the case when a crawl starts while there's another workflow still running. And/or a state filter on workflows.
We'll look into general pagination improvements in https://github.com/webrecorder/browsertrix/issues/1944
For now for the backend change to make is to ensure that running crawls are always floated to the top for "Latest Crawl" sort order.
We may look into additional changes to make but want to avoid having an opaque "Last Updated" type sort option with a complicated algorithm, as we had that before and removed it because users didn't understand the logic.
Got started on this in #2528 — this'll add an option to show running crawls separately from the rest of the crawls, so far with a separate pagination if necessary for both groups. Once this is done I'll also work on getting pagination persisted in URLs (e.g. /orgs/emmas-local-org/workflows?page=14)!
Another option is to reuse the super admin interface we already have for all running crawls, and just make it available for a single org.
Closing this with #2587 — this should make it into the upcoming 1.16 release!
I've created a new issue to track using arrow keys for using the pagination interface: https://github.com/webrecorder/browsertrix/issues/2596
Thanks for your input!