liulfy
liulfy
when I deployment a single server database using the following yaml: apiVersion: "database.arangodb.com/v1alpha" kind: "ArangoDeployment" metadata: name: "single-server" spec: mode: Single I don't know where to set the user and...
I just create a graph following this: https://github.com/ArangoDB-Community/pyArango/blob/master/examples/createSocialGraph.py I operate with pyArango, and when I try to get the indexes of the collection 'relation', I meet a problem `relation=db.collections['relation']` `relation.getIndexes()`...
In my case , I can deploy the vllm service on single GPU. but when I use multi gpu, I meet the ray OOM error. Could you please help solve...
When I try to build inverted index using `ensureIndex(index_type='inverted', fields=[ "_key" ])` It will raise exception `Traceback (most recent call last): File "", line 1, in File "/home/lib/python3.8/site-packages/pyArango/collection.py", line 624,...
### Required prerequisites - [X] I have read the documentation . - [X] I have searched the [Issue Tracker](https://github.com/baichuan-inc/baichuan-7B/issues) and [Discussions](https://github.com/baichuan-inc/baichuan-7B/discussions) that this hasn't already been reported. (+1 or comment...
### Your current environment When I try to inference qwen1.5 110b int4 (https://modelscope.cn/models/qwen/Qwen1.5-110B-Chat-GPTQ-Int4) with vllm(0.4.2) AsyncLlmEngine on A100 80G, I find the real batch size is just 2. I set...