yoyopdc

Results 2 comments of yoyopdc

I also had this problem in newest code I used the suggest command : python3 ../llama/build.py --model_dir /workspace/models/Mixtral-8x7B-v0.1/ --enable_context_fmha --use_gemm_plugin --world_size 2 --tp_size 2 --use_inflight_batching --output_dir /workspace/models/trt-engine/Mixtral_tp2/ --parallel_build and the...

I had tried,the tag v0.7.1 had no problem but the main had problem