EduChat icon indicating copy to clipboard operation
EduChat copied to clipboard

Published 20 hours ago • verified publisher icon ECNU-ICALK

如何支持多卡运行？

Open nathubs opened this issue 11 months ago • 1 comments

请教一下，如何支持多卡运行？

nathubs avatar Mar 15 '24 02:03 nathubs

可以使用vLLM来实现多卡并行的功能

DrJZhou avatar Mar 25 '24 04:03 DrJZhou