Dimitry Ageev

doesn't work correctly with * non-existed file or non-file paths: stuck without exit * stream=False doesn't work for regular log files, while loops forever

```unsatisfied condition: cuda>=11.8``` looks like you have old nvidia driver, try to update it

@d3v2a it looks like normal behavior. On start model allocates 3gb but when you start using it with large context (on large files for example) it allocates additional memory for...

@coder543 hi! We're using auto-gptq backend for most of the models (except of Refact, CONTRASTcode and codellama). They are 4bit quantized and should work with you setup (not sure about...