juan-OY

After exporting: export ONEAPI_DEVICE_SELECTOR=level_zero:1, it still fails (RWKV-py310) a770@RPLP-A770:~/ouyang/rwkv/models$ sycl-ls Warning: ONEAPI_DEVICE_SELECTOR environment variable is set to level_zero:1. To see the correct device id, please unset ONEAPI_DEVICE_SELECTOR. [ext_oneapi_level_zero:gpu:0] Intel(R) Level-Zero,...

It worked on single iGPU

thanks for the update.

Also found that 2.5.0b20240213 rwkv model loading at runtime is much slower than 2.5.0b20240204 about 4 min with 2.5.0b20240213, and 1 min with 2.5.0b20240204

rwkv5 issue still exist , bigdl version: 2.5.0b20240221 2024-02-21 22:17:22,445 - INFO - Converting the current model to sym_int4 format...... Can not read the prompt file, please check the file...

Below error on RWKV5 is fixed in latest release 2.5.0b20240221 out = out @ ow RuntimeError: mat1 and mat2 shapes cannot be multiplied (50x4096 and 8912896x1) The correct way to...

Resolved already.

python version 3.10

any update for this.

使用0llama-0.5.4-ipex-llm-2.2.0b20250226的时候，前端使用的是openWebUI的界面