CNXDZS
Results
1
comments of
CNXDZS
> use tensor parallel size 8 instead? thanks for your help!but I only have 6 gpus(T4 16G per GPU), and tensor parallel seems can't be higher than gpus?
CNXDZS
> use tensor parallel size 8 instead? thanks for your help!but I only have 6 gpus(T4 16G per GPU), and tensor parallel seems can't be higher than gpus?