Ammar Ahmad Awan issues

Repositories
Issues
Comments

Results 5 issues of


                                            Ammar Ahmad Awan

[zero-3] print warning once and support torch parameter

Type checking in zero-3 to avoid silent bugs

This is a follow-up PR to the existing one: https://github.com/microsoft/DeepSpeed/pull/2127 The goal is to keep this PR open and investigate the issue in more detail while the PR above removes...

Remove all unused quantize settings and flags.

UPDATE: We don't need to wait for the INT4 PR to get merged. Let's do this cleanup of unused quant vars. and flags independently. > @lekurile -- please work with...

Clean opt

run-example.sh fails with urllib3.exceptions.ProtocolError: Response ended prematurely

When I modified “run_example.sh” and changed backend to vllm, I got the error message down below, I will do some some check whether the error comes from server side or...