huggingface-vscode-endpoint-server

huggingface-vscode-endpoint-server copied to clipboard

When using the [HuggingFace LLM extension](https://marketplace.visualstudio.com/items?itemName=HuggingFace.huggingface-vscode) in [Codium](https://vscodium.com/), I encounter this error: ``` serde json error: data did not match any variant of untagged enum APIResponse ``` Note: this is...

iamjameswalters

ValueError: Could not load model bigcode/starcoder with any of the following classes

7

` pip freeze:` accelerate==0.19.0 anyio==3.6.2 boto3==1.26.135 botocore==1.29.135 certifi==2023.5.7 charset-normalizer==3.1.0 click==8.1.3 fastapi==0.95.2 filelock==3.12.0 fsspec==2023.5.0 h11==0.14.0 huggingface-hub==0.14.1 idna==3.4 jmespath==1.0.1 numpy==1.24.3 nvidia-cublas-cu11==11.10.3.66 nvidia-cuda-nvrtc-cu11==11.7.99 nvidia-cuda-runtime-cu11==11.7.99 nvidia-cudnn-cu11==8.5.0.96 packaging==23.1 psutil==5.9.5 pydantic==1.10.7 python-dateutil==2.8.2 pytorch-pretrained-bert==0.6.2 PyYAML==6.0 regex==2023.5.5 requests==2.30.0...

24mlight

Refactor generators and add ct2fast support

2

Hello, in my fork I: - refactored the generators - Added support loading ctranslate2 based models (starcoderct2fast) which are incredibly fast on consumer hardware - Added support to finding the...

piratos

Bump up the versions and pick accelerate from branch

1

meetpraveen

able to see the output in logs. But doesn't type in VSCode editor.. any thoughts

1

I am able to see the output in the logs. But it doesn't type in the vscode editor. Thanks

satnair

Mr-Blue-Sky-Candy

I want to use the starcoderplus model, does it support it?

2

Please let me know if this repository is suitable for starcoderplus?

wang-chunxing