navyverma
navyverma
@wangleis Any update on this?
@wangleis I have one more question. Does openvino support fork?
@wangleis Do I need to enable or setup anything at runtime for fork support?
@wangleis I am trying to load the networks in the parent process and inference calls are made in the forked child. The Infer() call is hanging in the child process....
@wangleis I am compiling model in parent process and then performing inference in multiple forked child process.
@wangleis Sorry for the initial update. My application is still using multiple threads even with ov::num_streams(0)
@wangleis OpenVINO version is 2023.3.0-13775-ceeafaf64f3-releases/2023/3. I will try with latest master branch and update you. @sunxiaoxia2022 Above example is running on multiple threads and in my use case my application...
@wangleis I ran my application on latest OpenVINO version: **2024.3.0-16041-1e3b88e4e3f-releases/2024/3** and still application uses multiple thread.
@wangleis I tried ov::num_streams(0) on master branch with OpenVINO version: 2024.4.0-16446-eb16f7fbd0d and my application started using single thread.
@yuslepukhin I am asking whether FP16 implementation is correct or not?