Tim Harmling

Response Matching requires context field because the field gets dropped by polars

1

### Reproduce: Just run a response match (llm) without the context column ### Error: polars.exceptions.ColumnNotFoundError: context ### Problem Code: response_quality.py line: 901 

Added BitsAndBytes Support

1

Hello Byaldi Team! ## Description I added BitsAndBytes support for all us GPU-poor people. This enables 4-bit/8-bit quantization to run the models on smaller GPUs or, in my case, leave...