InferLLM icon indicating copy to clipboard operation
InferLLM copied to clipboard

能否改为GPU辅助计算

Open bzy-080408 opened this issue 2 years ago • 6 comments

`bzy@server:~/InferLLM/build$ make
-- current platform: x86
-- Build with GPU.
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bzy/InferLLM/build
[ 2%] Building NVCC (Device) object CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o
/usr/lib/gcc/x86_64-linux-gnu/11/include/serializeintrin.h(41): error: identifier "__builtin_ia32_serialize" is undefined

/home/bzy/InferLLM/src/kern/naive/quantize.h(45): warning #177-D: variable "bs" was declared but never referenced

1 error detected in the compilation of "/home/bzy/InferLLM/src/kern/gpu/kernel_gpu.cu".
CMake Error at InferLLMGPU_generated_kernel_gpu.cu.o.cmake:280 (message):
Error generating file
/home/bzy/InferLLM/build/CMakeFiles/InferLLMGPU.dir/src/kern/gpu/./InferLLMGPU_generated_kernel_gpu.cu.o

make[2]: *** [CMakeFiles/InferLLMGPU.dir/build.make:522: CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o] 错误 1
make[1]: *** [CMakeFiles/Makefile2:94:CMakeFiles/InferLLMGPU.dir/all] 错误 2
make: *** [Makefile:91:all] 错误 2
`

bzy-080408 avatar Aug 23 '23 09:08 bzy-080408

system:ubuntu 22.04LTS
cuda,gcc等全为软件源中安装

bzy-080408 avatar Aug 23 '23 09:08 bzy-080408

现在编译成功了,但是src/core/device.h的113行我电脑需改为0,不然报invalid device,不知道其他电脑是什么样

bzy-080408 avatar Aug 23 '23 13:08 bzy-080408

但是目前能否改为GPU辅助计算,2G的显存似乎不够用

bzy-080408 avatar Aug 23 '23 13:08 bzy-080408

image

bzy-080408 avatar Aug 23 '23 13:08 bzy-080408

I changed the default device GPU id to 0, the new feature of GPU-assisted computing is not supported yet,

chenqy4933 avatar Aug 25 '23 03:08 chenqy4933

话说amd显卡有计划支持吗?

bzy-080408 avatar Aug 30 '23 06:08 bzy-080408