AutoAWQ
AutoAWQ copied to clipboard
Cohere Support
I see this is a draft PR. @TechxGenus have you done any further testing?
Hi @casper-hansen , I tested it with transformers, works well. Marked as draft as missing fusion layer implementation. I don't have enough hardware to write and test it recently. Maybe merge it and wait for a later commit.
@TechxGenus I was unable to commit to that PR, so I forked your forked branch and submitted a PR.
As mentioned in the PR's description, it seems to have been implemented plausibly but it does not work properly. I want to contribute to this cohere model support project, and I have the hardware necessary to conduct tests.
This is my first attempt at contributing to an open source project, so I might be inexperienced or incorrect in using Git. If there are any mistakes, I would appreciate your pointing them out. @TechxGenus @casper-hansen
Hi @casper-hansen , this PR has been tested in both modes and is ready for merging.
@casper-hansen can you please merge this PR by @TechxGenus. I really need this cohere capability :)
hello @casper-hansen, is there any issue with this PR? Could you please let me know if there is a reason for not merging it?
Sorry for taking so long. I took leave from working on open-source the past month.