codecodebear

Hi, I used ```SPRING``` to run my experiments (I used my own datasets) and found out that it usually outputted some unnecessary words in ```pred```. Specifically, it has a weird...

Hello, Thanks for your answer above! It solves the Bfloat16 problem. However, I encountered another issue: ``` (VllmWorkerProcess pid=4500) RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with...

Hi, Thanks again for your quick reply. I tried your second suggestion above, and it works. I am not 100% sure, but I think we need to run ```export VLLM_WORKER_MULTIPROC_METHOD=spawn```...