Rafael Dias comments

Repositories
Issues
Comments

Results 1 comments of


                                            Rafael Dias

[Usage] How to run inference for llava-next-72b?

> For llava-next-72b/110b at `lmms-eval`, `conv_template=qwen_1_5`. > > At slgang, it's slightly different, you can check the `examples/usage` folder at sglang's repo. I've trying to find this "examples/usage" but I...