Oleh Kuznetsov

icon indicating a website link https://github.com/sadaisystems

icon company MSD icon location Prague icon location Student at CTU in Prague, knowledge engineering. Currently working in MSD Czech Republic as LLM engineer (Emergent Talent Rotational Program)

Results 5 issues of Oleh Kuznetsov

Issue: LLamacpp wrapper slows down the model

3 comment

### Issue you'd like to raise. Looks like the inference time of the LLamacpp model is a lot slower when using LlamaCpp wrapper (compared to the llama-cpp original wrapper). Here...

Update llamacpp demonstration notebook

# Update llamacpp demonstration notebook Add instructions to install with BLAS backend, and update the example of model usage. Fixes #5071. However, it is more like a prevention of similar...

Wrong eval stages distribution when using `evals_per_epoch` parameter

1 comment

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Evaluations should happen at the...

bug

Unable to instantiate HuggingfaceEmbeddings

2 comment

[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Unable to instantiate `HuggingfaceEmbeddings`, because it doesn't implement asynchronous embed methods of base...

bug

No proper support for Tool Messages?

According to [example](https://github.com/ollama/ollama-python/blob/main/examples/tools.py) and definition of Message model, it seems like there is no way to actually represent executed tool message as a Message model, only using dictionary? I'm arriving...