Pang Xiaojian comments

Repositories
Issues
Comments

Results 2 comments of


                                            Pang Xiaojian

[Bug] DeepSeek-R1-AWQ failed

The same to me.

When the inference process encounters an out-of-memory (OOM) error, can the service automatically recover？

> Facing the same issue here. IMHO, even crashing the infinity process in such situation would be a better way, because pod can then get auto restarted. or this hang...