solaoi

Failed to run custom model with convert_model.py

4

Hi, I can't get it to work and I was wondering if you could advise me if the cause is the custom model itself, the conversion method or how to...

### Description We've identified and addressed an intermittent crash issue specifically occurring when using the `get_av_audio_buffer_list` method in the `screencapturekit-rs` library. The crashes were observed under certain conditions, not consistently...

Enable specifying the path to make it usable on Linux

How to use UQFF File locally without sending requests to Hugging Face?

19

## Describe the bug I'm trying to use UQFF File in a local environment only, but my sample code is still sending requests to Hugging Face. I would like to...

## Describe the bug When using the mistralrs library to process multiple requests in a loop, the blocking_recv call hangs indefinitely after the first iteration. This prevents the code from...

When attempting to run Gemma2 models in GGUF format using the example provided [here](https://github.com/EricLBuehler/mistral.rs/blob/master/mistralrs/examples/gguf_locally/main.rs), I encounter the following error: ``` Error: Unknown GGUF architecture `gemma2` ``` Is there a plan...

## Describe the bug When initializing and dropping the Model repeatedly: 1. Memory usage continuously increases as GGUF models aren't properly cleaned up 2. Channel is erroneously closed after the...