drewzeee

AttributeError: 'WeightOnlyGroupwiseQuantLinear' object has no attribute 'prequant_scaling_factor'

1

Receiving the above error when attempting to build the TRT engine. Using a 3090 with driver 546.33, CUDA 12.3 and tensorrt_llm-0.7.1 Traceback (most recent call last): File "Z:\oracle\model\TensorRT-LLM\examples\llama\build.py", line 983,...