wangxiyuan
wangxiyuan
**Description**: This PR adds Ascend CANN execution provider support. **Motivation and Context** - Why is this change required? What problem does it solve? As the info shown in the issue....
The docker image `openjdk:8-jre` only works for amd64. When running test on arm64, use `arm64v8/openjdk:8-jre` instead.
[Rocksdb 6.4.6](https://mvnrepository.com/artifact/org.rocksdb/rocksdbjni/6.4.6) release now contains `librocksdbjni-linux-aarch64.so` for aarch64 platform. It's good for frocksdb to support it as well. It's very easy to build the aarch64 package on an ARM machine:...
`_export` API was deprecated and should be removed after 2.0. See: https://github.com/pytorch/pytorch/pull/107208
### Motivation. Currently, vLLM support many hardware backend(cpu, cuda, hpu, neuron, openvino, rocm, tpu, xpu). Some other backend are also eager to be integrated by vllm([ascend](https://github.com/vllm-project/vllm/issues/7692), [IBM Spyre](https://github.com/vllm-project/vllm/issues/9652)). But as...