fan

Results 5 comments of fan
trafficstars

Give each element a unique HTML `id` or `class`

+1

batch_infer疑似死锁卡住[Bug]

一样的问题

当连续请求200多次后，出现突然卡住的情况

same 2*A100 26B

[Bug] 2x4090 with Llama2 70B silently crashes (i.e. without any error message in DEBUG mode) as of v0.6.0a0 and v0.6.0 (but works fine in previous versions)

出现一样问题，同样必须执行TM_DEBUG_LEVEL=DEBUG，模型才能运行。不然多卡出现一张卡占用100%锁死问题。

[Bug] 2x4090 with Llama2 70B silently crashes (i.e. without any error message in DEBUG mode) as of v0.6.0a0 and v0.6.0 (but works fine in previous versions)

> @josephrocca @fanghostt > > Can you reproduce it with other models? I can't reproduce it with Qwen2-7B-AWQ or Llama3-70B-AWQ with v0.6.0 on 2 RTX 4090 GPUs. same problem has...