intel-extension-for-transformers icon indicating copy to clipboard operation
intel-extension-for-transformers copied to clipboard

A beginner friendly quantize and text embeddings tutorial for XPUs

Open sleepingcat4 opened this issue 1 year ago • 3 comments
trafficstars

I have added a beginner friendly tutorial to illustrate how HF text embedding models can be quantised and loaded using Intel XPUs and then use to generate embeddings. (through jupyter notebook)

I have used "BAAI/bge-m3" model from HF and used Intel extension for transformers and transformers library to quantise it on XPU.

sleepingcat4 avatar Jul 14 '24 04:07 sleepingcat4