torch 2.3.x support

[younesbelkada]

Currently autoawq and autoawq_kernels seems to be not compatible for pytorch 2.3.0:

Python 3.8.16 (default, Mar  2 2023, 03:21:46) 
[GCC 11.2.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> import awq_ext
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: /python3.8/site-packages/awq_ext.cpython-38-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi
>>> 

One can repro by installing autoawq, autoawq_ext and torch 2.3.0 to get that error

cc @casper-hansen

[casper-hansen]

This is a pytorch-related issue. You are installing wheels that are built with 2.2.0 and trying with torch 2.3.0. To fix this, you need to build from source or wait until AutoAWQ kernels are updated to 2.3.0.

[WanBenLe]

+1 for this feature

[BenjaminBossan]

New kernels should solve this, right?

[casper-hansen]

@BenjaminBossan yes. I am building new kernels now and pushing an updated version to PyPi. Sorry for the delay - I plan to be faster at updating when new torch version is out.