leachee99 issues

Repositories
Issues
Comments

Results 2 issues of


                                            leachee99

[Question]how to run the mixtral inference in multi-node?

**Describe the bug** The program is killed by timeout of watchdog when I run deepspeed on mutli-node. **To Reproduce** Steps to reproduce the behavior: my code 1. Simple inference script...

bug

inference

can not run the test-gpt.sh because of assertionError

hi, I meet a problem when I run the DeepSpeedExamples/inference/huggingface/text-generation/run-generation-script/test-gpt.sh. The error is : ``` assert not config.replace_with_kernel_inject, "Cannot use both user specified injection policy and kernel injection" AssertionError: Cannot...