AutoAWQ
AutoAWQ copied to clipboard
Add Internlm2 support
This pull request implements support for InterLM2 in AutoAWQ. The integration has been successfully tested and generates high-quality output.
Changes include:
Added InterLM2 configurations to:
models/init.py
models/auto.py
models/base.py
Created a new file_: models/internlm2.py
Updated setup.py to include additional dependencies:
protobuf
sentencepiece
einops
Note: If there's a more efficient way to manage model-specific dependencies, it might be preferable to the current approach of adding them to the global requirements.