wangjiazhi
wangjiazhi
The paper states that "Images assigned with abnormal labels are positive samples while normal ones are negative samples.", and the score is in range of [0, 1]. So, it's a...
This PR works for me, with this PR, the FP8 W8A8 quantized model can run on 5070Ti GPU. https://github.com/vllm-project/vllm/pull/17280
Tested on 5070Ti, both methods (https://github.com/vllm-project/vllm/issues/14452 and https://github.com/vllm-project/vllm/pull/17280) work.