fastembed icon indicating copy to clipboard operation
fastembed copied to clipboard
verified publisher icon qdrant

Does support GPU inference ?

Open shatealaboxiaowang opened this issue 1 year ago • 1 comments

Hi, dear：

Thanks for your open source.i try to run colbert2.0 on cuda,but error. so, can it specific gpu device to run model ?

Looking forward your replay.

shatealaboxiaowang avatar Sep 18 '24 09:09 shatealaboxiaowang

Hi, yes, you can run fastembed models on gpu Have you seen this example ?

joein avatar Sep 23 '24 09:09 joein