localGPT icon indicating copy to clipboard operation
localGPT copied to clipboard

Published 20 hours ago • verified publisher icon PromtEngineer

Can other models and embeddings be used?

Open GuoChang2032 opened this issue 2 years ago • 3 comments

I encountered some problems after switching to a LlamaCpp model, so I would like to ask if it supports switching to another model? run runLocalGPT.py error InvalidDimensionException: Dimensionality of (384) does not match index dimensionality (768)

GuoChang2032 avatar Jun 01 '23 08:06 GuoChang2032

Currently, it will support models in the HF format. Will add support for other models.

PromtEngineer avatar Jun 02 '23 04:06 PromtEngineer

ok~

GuoChang2032 avatar Jun 02 '23 09:06 GuoChang2032

I'm repeating myself regarding those low-effort forks of privateGPT: just use CASALIOY. It's faster and solves the issues those repos won't fix.

su77ungr avatar Jun 04 '23 14:06 su77ungr