AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

Add Internlm2 support

Open Crystalcareai opened this issue 6 months ago • 0 comments

This pull request implements support for InterLM2 in AutoAWQ. The integration has been successfully tested and generates high-quality output.

Changes include:

Added InterLM2 configurations to:
    models/init.py
    models/auto.py
    models/base.py

Created a new file_: models/internlm2.py

Updated setup.py to include additional dependencies:
    protobuf
    sentencepiece
    einops

Note: If there's a more efficient way to manage model-specific dependencies, it might be preferable to the current approach of adding them to the global requirements.

Crystalcareai avatar Aug 08 '24 17:08 Crystalcareai