RobinQu

Package recipe for conan center

1

Tutorial: https://github.com/conan-io/conan-center-index/blob/master/docs/developing_recipes_locally.md Recipe repo: https://github.com/RobinQu/conan-center-index/blob/feature/add-instinct-cpp/recipes/instinct-cpp/all/conanfile.py

Limitations of mini-assistant

1

This is long live issue that tracks limitations of mini-assistant implementation. General speaking, `mini-assistant` is an all-in-one, single-node jukebox that mimick OpenAI's Assistant API. It's not intended for large-scale and...

bge-reranker is extreamly slow

10

With 686 tokens, a single run would take more than 6 secodns on a 96C machine. Here is the profiling data for compute graph. [bge-reranker-dump.txt](https://github.com/user-attachments/files/15910956/bge-reranker-dump.txt) Any advice for better performance?