Colton Peltier

@williamberman - Hi, I'm actually not at Schneider Electric anymore (hence the "SE" in my old name), I've switched to Databricks 🥳 . So I didn't see you had tagged...

> Hi @egils-mtx, I suspect this is due to a quirk of the HNSW algorithm, which is basically a greedy search through a graph. It essentially keeps a priority queue...

In my case I was using the `retriever` with a `RetrievalQA` chain. Increasing `k=50` improved my retrieval results as desired, but then overflowed my context size and the `RetrievalQA` would...

I was able to work around this by manually updating the tiktoken dictionary: ``` import tiktoken tiktoken.model.MODEL_TO_ENCODING["gpt-35-turbo"] = "cl100k_base" ```