Krishna Nadiminti

icon indicating an email [email protected]

icon company Nylas icon location Bay Area icon location Machine Learning Engineer,Masters in Bioinformatics

Results 4 comments of Krishna Nadiminti

bug: aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected

Thanks @sudeepg545 ! I will look into this POV. Will update on this @jianshen92 .

[BUG] DeepSpeed Inference example in the tutorial got killed for no reason.

Interesting! Having the same bug for 2 GPU settings, 1 GPU one is working fine for me.

bug: aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected

I am even facing this issue mainly on transformer models, any one had any breakthrough ?

bug: aiohttp.client_exceptions.ServerDisconnectedError: Server disconnected

Hi @jianshen92 ! I hope this one I created earlier would help! https://github.com/bentoml/BentoML/issues/4238 bentoml serve bento:xx works fine. but containerizing and running the container kind of causes this issue.