Sergei Belenki comments

Repositories
Issues
Comments

Results 2 comments of


                                            Sergei Belenki

Support Mistral-Nemo-Instruct-2407 128K

> Just tried with latest quants at [QuantFactory/Mistral-Nemo-Instruct-2407-GGUF](https://huggingface.co/QuantFactory/Mistral-Nemo-Instruct-2407-GGUF/discussions/1#669c282fc9111326dcfc36fb) and build 3437, getting the following error (Xeon E-2176G with 64GB RAM, under Debian). Apparently it's trying to allocate a very large...

Citations are sometimes wrong

Same here. Was testing Danswer on one connected document source (with one document to reference) and got 26 rows in the results, some of which were duplicated, with references to...