gtpgg1013

> I got these _mm256_fmadd_ps errors in VirtualBox too. In my case i changed this in the Makefile: > > ``` > ifeq ($(UNAME_M),$(filter $(UNAME_M),x86_64 i686 amd64)) > # Use...

Hi, Thanks for your help. I encountered the similar situation while fine tuning. My error : RuntimeError: No suitable kernel. h_in=16 h_out=19200 dtype=Float out_dtype=BFloat16 Could you say how can I...

> I made a fix with recent changes on vLLM. https://github.com/seungduk-yanolja/vllm-deepseek > > Assuming you have an 8xH100 machine, to run, > > ``` > python -m vllm.entrypoints.openai.api_server --model deepseek-ai/DeepSeek-V2-Chat...

> > > I made a fix with recent changes on vLLM. https://github.com/seungduk-yanolja/vllm-deepseek > > > Assuming you have an 8xH100 machine, to run, > > > ``` > >...