dingbaorong issues

Repositories
Issues
Comments

Results 1 issues of


                                            dingbaorong

Inference with inputs with sequence length increased will cause OOM

### Describe the bug When `seq_len` get larger and larger, the device memory utilization will get higher and finally gets OOM on Arc770. But if you simply run once inference...

ARC

Crash

LLM