Gareth

Thanks for posting this log! That's fantastic. Looks like it's blocked on Dequeue in the orchestrator, what's interesting is that the queue has only been stuck for ~3 minutes in...

Significantly simplified the task queue implementation in https://github.com/garethgeorge/backrest/commit/8b9280ed57b84b7da814e285542c57b7c14209ae , the refactoring generalizes the implementation and breaks it up for more modular test coverage as the previous implementation was very hard...

snip: found some significant bugs in the revised orchestrator, reverting it for now. Going to keep iterating on this.

Released the new task queue implementation in 0.17.2 which fixes some causes of deadlock that existed in the original implementation. I'd be interested to have you give it a go...

Darn, that's disappointing. If either of you get more logs (or traces to post) that'll continue to be helpful. One "cludge" (in my opinion) work around would be for me...

Thanks for the callout and agree re: #315 likely related, it's worth note that this is fixed as of version 1.2.0 .

Hmm, thinking through this I can see that the idea of parallel backup options is immediately appealing as it sounds like it should be a speedup -- but I'm interested...

OK, I'm open to this but I think I'm going to consider it low priority for now -- I think my near term focus is continuing to improve, reliability, unblock...

I think I'm reasonably comfortable moving this up the priority list; Backrest can move to a model where operations can run in parallel across repos (but are still serialized for...

This would be really valuable @johnmaguire , windows is definitely where my knowledge thins. I think a windows installer would do a lot to ease adoption.