crusty-core icon indicating copy to clipboard operation
crusty-core copied to clipboard

Consider lifting Send+Sync restrictions and migrating to a single thread tokio runtime

Open let4be opened this issue 4 years ago • 0 comments

We could simplify && speed things up => spawn several Crawlers in their own threads, we already handle job delegation via channels this way we have less internal/external Send/Sync restrictions and we do not bother tokio with work stealing schenanigans which most likely hurt more than help in our use case

after this is implemented, can review https://github.com/let4be/crusty/issues/35 probably could use Actix here and there

let4be avatar Jul 24 '21 15:07 let4be