Sufiyan Adhikari issues

Repositories
Issues
Comments

Results 12 issues of


                                            Sufiyan Adhikari

Performance issues on AWQ and Lora

### System Info docker image: `ghcr.io/predibase/lorax:07addea` because main image isn't working on latest drivers device: Nvidia A100 80GB models in use: `meta-llama/Meta-Llama-3.1-8B-Instruct` and `hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4` loras finetuned with [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) ### Information...

Missing filters

The library seem to be missing some filters, eg. round from [jinja2](https://jinja.palletsprojects.com/en/3.1.x/templates/#list-of-builtin-filters) I will try to raise a PR for round filter. we can make some `good first issue` issues...