Bryan

About library reference in Linux

3

Hi, I try to run the project in Linux After executing the following commands ./b2 libs/ui/build/ cxxflags=-std=c++0x ./b2 libs/ui/test/ cxxflags=-std=c++0x ./b2 libs/ui/example/ cxxflags=-std=c++0x ./b2 libs/ui/example/cpp11/ cxxflags=-std=c++0x I can successfully run...

Providers: HuggingFace

1

Hi, I'm new to Langchain and LLM. I've recently deployed an LLM model using the Hugging Face text-generation-inference library on my local machine. I've successfully accessed the model using Python...

Support for AWQ quantization in TGI

1

Hi As I tried with 13b version in TGI, it works fine with bitsandbytes quantization. While trying with AWQ quantization in TGI, it shows error as "Cannot load 'awq' weight,...