service-streamer icon indicating copy to clipboard operation
service-streamer copied to clipboard

Published 20 hours ago • verified publisher icon ShannonAI

Streamer Windows Support

Open kogolobo opened this issue 4 years ago • 1 comments

Hi,

I am working on using your multi-gpu Streamer for on-demand BERT inference. Due to other app requirements, I have to deploy it on a Windows server. ThreadedStreamer seems to work fine, however, when I use the multi-gpu Streamer, it seems like it is running into some issues when it tries creating worker threads (since fork() in not available in Windows). Error message: image

Could you please help me solve this?

kogolobo avatar Feb 27 '20 01:02 kogolobo

Try add freeze_support as suggested. Btw, the default multi processing in this code is using spawn not fork.

Meteorix avatar Feb 27 '20 04:02 Meteorix