shadowinder
shadowinder
me too ，have the same issue `llama_get_logits_ith: invalid logits id X, reason: no logits`
> i am pushing a release at my fork for x86_64_cu_124 update: i have compiled a working version as a temporarily fix and uploaded to my fork, feel free to...
> > check this out 😊，it runs with single RTX 3090, multiple GPU should work, but not tested in my machine > > Looks great! Are you use the master...
Can you use the proxy http://172.21.51.30:3128 normally? I checked the source code of the latest released version and it seems that the proxy parameter of openaiclient is not passed, and...