BaideBear

Error when running chatglm3_6b: NotImplementedError: Unknown device for graph fuser

2

### System Info ```shell (habanalabs-venv) (habanalabs-venv) root@vmInstancetmhmacpr:~/lier_workload/test# python inference_test.py /usr/lib/python3.10/inspect.py:288: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead return isinstance(object, types.FunctionType) Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████| 7/7 [00:00

[Feature Request]Explanation of Parallel Techniques

3

### Prerequisites - [x] I have searched existing issues and reviewed documentation. ### Problem Description May I ask what parallel techniques you have implemented? When setting CUDA_VISIBLE_DEVICES=0,1,2,3, all four cards...

[Feature Request] The Compatibility with DeepSeek V3

1

### Prerequisites - [x] I have searched existing issues and reviewed documentation. ### Problem Description Does the current code framework support DeepSeek V3? I found DeepSeek V3 model files in...