vllm
vllm copied to clipboard
Update a more user-friendly error message, offering more considerate advice for beginners, when using V100 GPU #1901
For the sake of future beginners, it is suggested to provide guidance in the error message, suggesting users to add --dtype="half" to specify the data type. in issue #1901