llm-vscode-inference-server icon indicating copy to clipboard operation
llm-vscode-inference-server copied to clipboard

Can't pip install requirements.txt on CPU-only system

Open ciprianelies opened this issue 1 year ago • 2 comments
trafficstars

I saw the README references running on CPU as a goal, is the project there right now or is there still work to be done to achieve that? Currently I'm seeing this error if I try pip install -r requirements.txt:

      RuntimeError: Cannot find CUDA_HOME. CUDA must be available to build the package.

ciprianelies avatar Dec 07 '23 01:12 ciprianelies

Thank you for your query. The CPU feature is in progress, but my availability to advance it is limited for now. Your patience is appreciated.

wangcx18 avatar Dec 07 '23 11:12 wangcx18

I've encountered this as well. Hope this can be added!

iamjameswalters avatar Mar 08 '24 21:03 iamjameswalters