johnysh comments

Results 3 comments of


                                            johnysh

Run InternLM2 , reports error:TypeError: internlm2_attention_forward() got an unexpected keyword argument 'cache_position'

model = AutoModelForCausalLM.from_pretrained(model_path, load_in_4bit=True, trust_remote_code=True, use_cache=True) I set “load_in_4bit=False” and made the model running , but the speed turned slow and hoped it could help you to find a direction....

Run InternLM2 , reports error:TypeError: internlm2_attention_forward() got an unexpected keyword argument 'cache_position'

Follow this bkc ,and add revision="v1.1.0" ,it can run well. Thx From: Kai Huang ***@***.***> Sent: Monday, August 12, 2024 10:48 AM To: intel-analytics/ipex-llm ***@***.***> Cc: Shi, Junhan ***@***.***>; Author...

GPU resource cannot be used in wsl2: misc dxg: dxgk: dxgkio_query_adapter_info: Ioctl failed: -22/-2

I have the same issue too C:\Users\Local_Admin>wsl --version WSL version: 2.4.10.0 Kernel version: 5.15.167.4-1 WSLg version: 1.0.65 MSRDC version: 1.2.5716 Direct3D version: 1.611.1-81528511 DXCore version: 10.0.26100.1-240331-1435.ge-release Windows version: 10.0.26100.2894