DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Fix Bug in transform.cu

Open rraminen opened this issue 1 year ago • 3 comments

This is to fix the below error

/opt/conda/lib/python3.8/site-packages/deepspeed/ops/csrc/transformer/inference/csrc/transform.hip:688:6: error: function template partial specialization is not allowed
void launch_transform4d_0213<T>(T* out,
     ^                      ~~~

cc: @jithunnair-amd

rraminen avatar May 12 '23 19:05 rraminen

@rraminen - curious what you ran that you came across this?

loadams avatar May 15 '23 23:05 loadams

@rraminen - curious what you ran that you came across this?

I was running the Deepspeed-Inference workloads from https://github.com/huggingface/transformers-bloom-inference.git

rraminen avatar May 16 '23 04:05 rraminen

This error also comes up when building DeepSpeed with 'deepspeed.ops.transformer.inference.transformer_inference_op' extension in non-JIT way

rraminen avatar May 23 '23 21:05 rraminen