lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard

Confused about cuda version, cuda 10.2 or cuda 11.6 are supported or not by lightseq inference

Open lilyzlt opened this issue 2 years ago • 2 comments

when I run inference coda, cuda version cannot > cuda 11, it only works at cuda 10.2 (one issue also about this problem) eg: run code in lightseq/examples/inference/python/test/

when I build from source, follow the https://github.com/bytedance/lightseq/blob/master/docs/inference/build.md the requirement :cudatoolkit-dev >= 10.1 < 11 but at the CMakeList.txt :find_package(CUDA 11.6 REQUIRED)which means it need CUDA 11.6,

so I am confused now about CUDA version, any update about this?

lilyzlt avatar May 11 '22 09:05 lilyzlt

just confirmed, V2.2.0 version CMakeList.txt require cuda version is 10.1 latest version require cuda version is 11.6 that means base on your version of cuda, build different .so file, right? if I wanna build from source using cmake, but cuda =10.2, how to build it ? image

lilyzlt avatar May 11 '22 09:05 lilyzlt

But fairseq only support 10.2, how to deal with this?

LiYijin avatar Jul 18 '22 07:07 LiYijin