hipudding

Reference implementation #17700 #19443

> Hello, if possible, could you show me a demo of how to use Lightning on an NPU? Yes, it's very simple to use npu instead of other backends. Just...

> @hipudding @hhllxx1121 More and more device manufacturers need to support their own backends. Can this be achieved by using the PrivateUse1 mechanism? As far as I know. pytorch-lightning use...

Sorry for late reply. llama.cpp does not support Ascend310B now.

@mchiang0610 I have physical machine with Ascend NPU, I can share it with you. But the resource is very limited, there're some developer are working together on it. I can...

> Can you package a beta version? I'd like to test it out You can checkout this PR and follow [develop guide](https://github.com/ollama/ollama/blob/main/docs/development.md) to build by yourself.

I got this error when executing ollama run.  and it seems no ascend dir under runners. ``` uname -a Linux hua-docker 4.19.90-vhulk2211.3.0.h1804.eulerosv2r10.aarch64 #1 SMP Mon Jun 3 18:15:36 UTC...

@AspartameJ I saw your log. The model has been split into more than 300 graphs. Which means it need copy data between these graphs. For 0.5b model, you can use...

> > @AspartameJ I saw your log. The model has been split into more than 300 graphs. Which means it need copy data between these graphs. For 0.5b model, you...

> Could you please send me a usable packaged file? I'm unable to access the external network on the Huawei server, and I don't have a compilation software environment here....