James Leong

Results 6 comments of James Leong

Encountered the same problem, has anyone solved this problem?

if you want to limit the number of connections, you can set the `max_connections` parameter when initializing the ConnectionPool object.

> Are you able to reproduce this issue without pytorch? You may have to write > > a small program and call cudaInit() yourself. > > > > I suspect...

I'm afraid I have to say that the project doesn't support pytorch at present. @dyunwei

First, it is necessary to analyze the CUDA-related interfaces used by PyTorch, and then implement the RPC call process for these interfaces in these two files: [manual_server.cpp](https://github.com/kevmo314/scuda/blob/main/codegen/manual_server.cpp), [manual_client.cpp](https://github.com/kevmo314/scuda/blob/main/codegen/manual_client.cpp). I previously...

I think the GPU-dependent methods in cudnn should also be intercepted, but the methods that should be executed locally indeed should not be sent to the remote. @violinY