Seungjae Lim

icon indicating an email [email protected]

icon company @casys-kaist icon location KAIST, 291 Daehak-ro, Yuseong-gu, Daejeon icon location M.S. Student at KAIST CASys

Results 2 issues of Seungjae Lim

[Bug]: vllm/vllm/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol error

5 comment

### Your current environment ```text The output of `python collect_env.py` Collecting environment information... PyTorch version: 2.1.2+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build...

installation

huggingface_bert_convert.py can't convert some key

### Description branch: `v1.4` docker version: `22.12` `huggingface_bert_convert.py` can't convert some key ``` python3 FasterTransformer/examples/pytorch/bert/utils/huggingface_bert_convert.py \ -in_file bert-base-uncased/ \ -saved_dir ${WORKSPACE}/all_models/bert/fastertransformer/1/ \ -infer_tensor_para_size 1 ``` Response: ``` =============== Argument ===============...

bug