PikaPikachu

icon indicating an email [email protected]

icon company Intel icon location Shanghai

Results 7 comments of PikaPikachu

How to deploy qwen-vl using tensorrtllm_backend?

Same here. help!

Qwen2-VL support

Is there any update on this issue?

NVILA support (Qwen2)

any update?

Qwen2.5 VL sglang's output much worse than transformers

Any update? @mickqian

this sample func seems like a bug...

okk，不过这个norm_logits没有考虑temperature为0的情况，跑temperature=0会nan

this sample func seems like a bug...

就是这一行会错 https://github.com/Infini-AI-Lab/TriForce/blob/main/utils/decoding.py#L23

this sample func seems like a bug...

还有这里 https://github.com/Infini-AI-Lab/TriForce/blob/164c8c0131cf49951eefdea89a3fbcccb8ca326b/utils/decoding.py#L32 和这里 https://github.com/Infini-AI-Lab/TriForce/blob/164c8c0131cf49951eefdea89a3fbcccb8ca326b/utils/decoding.py#L62