luocaodan

Results 3 comments of


                                            luocaodan

Prompt Size not Equal to Each Other

met the same issue

auto_gptq-0.7.1.tar.gz has inconsistent version: expected '0.7.1', but metadata has '0.7.1+cu121

face same issue in windows python3.12. any workaround to solve it?

[Question]: onnxruntime::WaitNotificationFn) Available memory of 0 is smaller than requested bytes of 175657216

same issue. any solution?