forcekkk

Results 2 issues of forcekkk

error in setup spconv1.2.1

4 comment

running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.6 creating build/lib.linux-x86_64-3.6/spconv copying spconv/__init__.py -> build/lib.linux-x86_64-3.6/spconv copying spconv/conv.py -> build/lib.linux-x86_64-3.6/spconv copying spconv/functional.py -> build/lib.linux-x86_64-3.6/spconv copying spconv/identity.py -> build/lib.linux-x86_64-3.6/spconv copying spconv/modules.py...

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:7 and cuda:0! (when checking argument for argument index in method wrapper_CUDA__index_select)

I want to use 8 4090(24G) to quantize the W4A4 for llama-7b, but it will have this error. python main.py \ --model ./llama-7b --epochs 1 --output_dir ./log/llama-7b-w4a4 --eval_ppl --wbits 4...