RobinQu
RobinQu
In a fresh conda env, ater pip install, the following command (mentioned in this [PR](https://github.com/microsoft/DeepSpeed-MII/pull/317)) is no longer working. ``` python -m mii.entrypoints.openai_api_server --model "mistralai/Mistral-7B-Instruct-v0.1" --port 3000 --host 0.0.0.0 ```...
See more in code, just few lines though
Hi, team. I am developing a brand new agent framework [instinct.cpp](https://github.com/RobinQu/instinct.cpp). In [latest version](https://github.com/RobinQu/instinct.cpp/blob/main/modules/instinct-llm/include/agent/patterns/llm_compiler/LLMCompilerAgentExecutor.hpp), I tried to implement parallel function calling with the idea from your paper. And it actually...
I am having trouble to consume endpoints of Ollama.app, while curl and debug utilities like Postman are working just fine. # Envrionment conan detected profile ``` arch=armv8 build_type=Release compiler=apple-clang compiler.cppstd=gnu17...
For better evaluation result in HF QA dataset. * Reranking: BCE, BGE-M3 scoring * Query rewrite * to generate SQL filter for given prompt * to generate hyperthecial queries
Conan related * [x] rpp via conan. blocking by https://github.com/victimsnino/ReactivePlusPlus/issues/548 * [ ] figure out how to build a header-only package CI related * [ ] github actions for CI...