stanza
stanza copied to clipboard
Stanza is not ThreadSafe like Spacy?
What I came to know that : Stanza does not work with multiple async workers if they are accessing the same model.
Is there any way to handle this ? Or Am I missing any point here ?
There really hasn't been much effort put into making it thread safe, but at the same time I'm not sure we'd get a lot of benefit from even trying. Pytorch will use up the GPU in just one thread if available, or fork a bunch on the CPU if there is no GPU