Robert Brennan
Robert Brennan
Looks like the toast keeps popping up so long as the connection isn't working. Can we just make a single sticky toast?
Looks great!
@shanghailiwei if the README doesn't work for you, can you file a new issue and fill out the bug template?
🤔 it looks like the summarization step is still trying to use OpenAI, even though you've specified a different model...
@pegostar the fact that it keeps on giving the same message back isn't super surprising--the local/OSS models aren't very good
At some point I was finding the first `{` and last `}` in the response before parsing it. Maybe that code was lost? It's pretty robust
Let's get this in, I don't think it'll hurt anything
It looks like 3.12 support is trickling through the dependency stream. onnxruntime just added support, which should get pulled in by chromadb https://github.com/microsoft/onnxruntime/issues/17842 In the meantime, maybe we can adjust...
Actually it looks like Chroma did too? https://github.com/chroma-core/chroma/pull/1715 There's been a release since that merge too, 0.4.24 on 2/27
Maybe we need to open an issue here? https://github.com/chroma-core/hnswlib Regardless--rather than downgrading to 3.11 for everyone, if we want to make a change here we should just downgrade for windows...