Dr. Artificial曾小健
Results
54
comments of
Dr. Artificial曾小健
> This PR enables the universal checkpoint for zero stage 3. > > Notes: > > * The current implementation supports Data parallelism. > * Development is ongoing for universal...
> @Orion-Zheng, are you still having this issue? yes
> vllm-project/vllm#4650 How much tokens/s this open source version can achieve? on 8*H800 ?