Logan Adams

Results 466 comments of Logan Adams

[BUG] CUDA error: no kernel image is available for execution on the device

Hi @getao - if you do build with DS_BUILD_FISED_ADAM=1 pip install deepspeed do you get the same erorr?

[BUG] CUDA error: no kernel image is available for execution on the device

Thanks @getao and @SamMicheals for confirming, we will need to take a closer look at this

[BUG] CUDA error: no kernel image is available for execution on the device

Hi @getao, @bwnotfound, @mzamini92 - could you please test with the linked PR here. #6669?

[BUG] RuntimeError: Error building extension 'inference_core_ops'

Hi @Chetan3200 - thanks for the report. A question, if you try to just run the following in your conda env: ``` DS_BUILD_OPS=1 pip install deepspeed ``` Do you get...

[BUG] RuntimeError: Error building extension 'inference_core_ops'

Hi @Chetan3200 - curious if you are still hitting this issue?

[BUG] RuntimeError: Error building extension 'inference_core_ops'

Hi @Chetan3200 - closing this issue for now. I'm not able to repro this on our hardware.

[REQUEST] Support for compile without NCCL dependency

@studyingflying - can you share the error that you hit when installing DeepSpeed?

DeepSpeed with Phi-3-mini-128K-instruct does not generate `<|endoftext|>` token

Thanks for reporting this @shubhanshu786 - I'll try to take a look.

How to start deepspeed automatically?

Hi @qwerfdsadad - you should be able to start with the docs [here](https://www.deepspeed.ai/getting-started/#writing-deepspeed-models) to see how to conditionally wrap your model with DeepSpeed. Zero stages 1,2, and 3 come with...

How to start deepspeed automatically?

Hi @qwerfdsadad - closing this as stale for now. Please comment if you need more assistance.