Rohan Pooniwala

icon indicating a website link www.linkedin.com/in/rohan-pooniwala icon indicating an email [email protected]

icon location Hello, I am an AI Researcher and Game Developer. I am interested in new upcoming technologies like Deep Learning and AR/VR.

Results 3 comments of Rohan Pooniwala

Tunnel is disconnected almost immediately

I had a similar issue. Turns out I had to **open all the ports for my server in the network firewall** as Client tries to connect to assigned port on...

Unable to deploy lmsys/vicuna-13b-v1.5-16k

Hey! I am able to deploy `lmsys/vicuna-13b-v1.5-16k` on 4 x Nvidia A10Gs (g5.12xlarge) using the latest image Here is the command I am using to run it `docker run --gpus...

Unable to deploy lmsys/vicuna-13b-v1.5-16k

I am using v1.0.0 because AFAIK, TGI supported Rope Scaling after releasing v1.0.0 and `lmsys/vicuna-13b-v1.5-16k` uses it. From their HF Page -> ```Vicuna v1.5 (16k) is fine-tuned from Llama 2...