老银

https://lowbibi.com [email protected]

nanjing [email protected]

Results 13 comments of


                                            老银

我用官方提供的代码部署会报错RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

我用7b模型好像也会，换成14b就ok的

requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/Systran/faster-whisper-large-v2/revision/main (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7455455bd0>: Failed to establish a new connection: [Errno 111] Connection refused'))"), '(Request ID: 67d58be6-cc3b-4d3c-a0d8-d558d50d3f0d)')

翻墙就ok了

api调用，必须将模型量化保存为int4才能使用，否则返回结果为<unk>

我甚至int4 也全部是 unk

‹
1
2