jane

Problems with hip implementing atomic on AMD GPU

2

Hello,everyone. I have some questions about atomic while using HIP.When I want to use atomic.load() in a __device__ function based on the **hip:rocm-4.0.0 version,** error like ： ../bucket.cuh:48:44: error: no...

hipMemcpy problem: Data_d cannot be accessed on the device side

2

hello,everyone. I would like to ask a question about hipMemcpy.I hope someone can help me with this. The question are as follows: I want to copy a table to the...

INT4-AWQ PPL results for LLaMA-2 model are not as expected

9

Hi, I have a question about why the int4-AWQ PPL results of the LLaMA-2 model very different from the paper? in paper result, LLaMA-2 + int4-AWQ PPL result is **5.60**,...

Hi, I want to run the aimet_zoo_torch/mobilebert/evaluators/mobilebert_quanteval.py ,but I'm getting the error of load_checkpoint in model.get_quantsim(): ` File "/opt/conda/lib/python3.10/site-packages/aimet_torch/quantsim.py", line 2106, in load_checkpoint sim = pickle.load(file) TypeError: Enum.__new__() missing 1...