Vincent C

Trained a transformer model ,but cannot infer (CUDA ERROR): invalid device function

5

Hello team, I trained a model using the lightseq-train command. Then i converted it to "pb" format. Finally, I run the infer with this code: ``` import lightseq.inference as lsi...

where is the lightseq.inference Transformer class file?

1

hello team, I am following the tutorial to load a transformer model with a PB format file. Code: ``` import lightseq.inference as lsi import sys file_name = sys.argv[1] model =...

cuda, torch version

3

hello team, could you please add some details about the package requirements? like the version of Cuda, the version of the torch. Thank you!