Matthew Steele comments

Repositories
Issues
Comments

Results 6 comments of


                                            Matthew Steele

Possibility to update or/and delete a property

+1 for this feature

Support for batch patch (partial update)

+1 would really like this feature, am doing some object updating with LLMs and was surprised that the bulk updates are actually the bottleneck

msdd_model.diarize() RuntimeError: shape '[138, 50, 16, 192]' is invalid for input of size 84787200

@Ko8rah did you ever find a solution? I am having the same problem.

Llama-3 support

> > > Yes it is. And hf-chat sends that stop token currently. > > > > > > Why does my local deployment of llama3-70b-instruct perform worse than Hugging...

HNSW Multi-value vectors (colbert)

+1 would dramatically simplify my schema and queries.

Can't run llama3.1-70b at full context

same here for 3.1-70b. just adding that I'm using AWQ and can only run something like ~23k tokens on 2x a6000 ada (96 GB total VRAM), while using VLLM I...