mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Published 20 hours ago • verified publisher icon EricLBuehler

mistral does not support NVIDIA V100 (compute_cap <= 800)

Open thesues opened this issue 9 months ago • 1 comments

Describe the bug it does not support some old hardware.

Can it just convert bfloat16 to float16 before loading model. just like vllm is doing?

thesues avatar May 14 '24 18:05 thesues