aikit
aikit copied to clipboard
[REQ] fine tune output to exl2 or awq
What kind of request is this?
New feature
What is your request or suggestion?
finetune output should support output to EXL2 or AWQ to be used with exllama2 or other backends
Are you willing to submit PRs to contribute to this feature request?
- [ ] Yes, I am willing to implement it.