intel-extension-for-transformers icon indicating copy to clipboard operation
intel-extension-for-transformers copied to clipboard

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Results 95 intel-extension-for-transformers issues
Sort by recently updated
recently updated
newest added
trafficstars

"In the latest version of the code, you changed the type of the parameter 'args.tasks' to a string. There is an issue with the validation and handling of this parameter...

Bumps [langchain-community](https://github.com/langchain-ai/langchain) from 0.0.27 to 0.2.5. Release notes Sourced from langchain-community's releases. langchain-community==0.2.5 Release langchain-community==0.2.5 Changes since langchain-community==0.2.4 community: release 0.2.5 (#22923) docs: Fix wrongly referenced class name in confluence.py...

dependencies
python
1.5

## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...

## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...

In the examples you guys didn't mention how to specify parameters like batch size, max input length etc. My first question is how to change the max input length, I...

documentation

I have succeeded to run ./chatglm3-6b by Intel-extension-for-transformers on my laptop, but I try to use Nueral Chat to run the same model(./chatglm3-6b) then fail: " Process finished with exit...

I have added a beginner friendly tutorial to illustrate how HF text embedding models can be quantised and loaded using Intel XPUs and then use to generate embeddings. (through jupyter...

![image](https://github.com/intel/intel-extension-for-transformers/assets/105184542/ab02187c-9d83-4590-86e2-52564f34d4e1) phi2 Fp32 model ![image](https://github.com/intel/intel-extension-for-transformers/assets/105184542/9d2b6c2b-42a5-4592-b7a5-62729ed6440e) phi-2-int4-inc

## Type of Change feature or bug fix or documentation or others API changed or not yes ## Description update ipex api detail description ![image](https://github.com/intel/intel-extension-for-transformers/assets/105184542/b938f243-8b31-43f7-ab74-65eab22fc0dd)

## Type of Change Bug Fix API Unchanged ## Description Working with customer on a 1.15.0 IDC machine, and he could not get neural_chat_server to run because the base of...