Aditya Ravishankar issues

Repositories
Issues
Comments

Results 2 issues of


                                            Aditya Ravishankar

Invocation bugs creeping up at high request rates

**Describe the bug** I am running a multi-node cluster (Master + 2 Worker nodes), with vHive running on this cluster. When I deploy a short running function (execution time ~...

bug

Running multi GPU inference

Hi, I was using the sample.py file for running inference. While it works fine on a single GPU, I wanted to know how I can run it across multiple GPUs?