kot197

Results 1 issues of kot197

Hi, I just want to run this simple code on GPU... ``` from langchain_community.llms import CTransformers llm = CTransformers(model="./airoboros-mistral2.2-7b.Q4_K_S.gguf", model_type="mistral", gpu_layers=32, verbose=True) print(llm.invoke('AI is going to')) ``` ![image](https://github.com/user-attachments/assets/97b8d8df-06b7-4ba0-9ac8-16368f7cb398) As you...