Jin Liu

Forschungszentrum Informatik Karlsruhe

Results 3 comments of


                                            Jin Liu

Multi-node serving with vLLM - Problems with Ray

have you solved the problem? have the same error with multi-node inference

[BUG]transformer_inference.so: cannot open shared object file: No such file or directory

I have the same problem for ds inference with bloom 176B

I can't install neuralcoref

any upgrade here?