lightllm icon indicating copy to clipboard operation
lightllm copied to clipboard
verified publisher icon ModelTC

Serving VLM VILA

Open anhnhust opened this issue 1 year ago • 0 comments

Hello,

I want to deploy the VILA model for serving VILA1.5-3B-AWQ (https://github.com/NVlabs/VILA). Could you please guide me on how to get started? Are there any specific instructions or tools I should follow for setting up the serving environment?

anhnhust avatar Dec 04 '24 07:12 anhnhust