加载量化版的4bit chatglm3 运行报错,RuntimeError: Library cudart is not initialized

[jasoncow007]

cpm_kernels库已经正确安装,但还是会出下如下错误，求解！

Load TEXT_ENCODER... !!! Exception during processing !!! Library cudart is not initialized Traceback (most recent call last): File "D:\ComfyUI-aki-v1.2\execution.py", line 317, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "D:\ComfyUI-aki-v1.2\execution.py", line 192, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "D:\ComfyUI-aki-v1.2\execution.py", line 169, in _map_node_over_list process_inputs(input_dict, i) File "D:\ComfyUI-aki-v1.2\execution.py", line 158, in process_inputs results.append(getattr(obj, func)(**inputs)) File "D:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper\nodes.py", line 188, in loadmodel text_encoder.quantize(4) File "D:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper\kolors\models\modeling_chatglm.py", line 852, in quantize quantize(self.encoder, weight_bit_width) File "D:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper\kolors\models\quantization.py", line 155, in quantize layer.self_attention.query_key_value = QuantizedLinear( File "D:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper\kolors\models\quantization.py", line 139, in init self.weight = compress_int4_weight(self.weight) File "D:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper\kolors\models\quantization.py", line 78, in compress_int4_weight kernels.int4WeightCompression( File "D:\ComfyUI-aki-v1.2\python\lib\site-packages\cpm_kernels\kernels\base.py", line 48, in call func = self._prepare_func() File "D:\ComfyUI-aki-v1.2\python\lib\site-packages\cpm_kernels\kernels\base.py", line 36, in _prepare_func curr_device = cudart.cudaGetDevice() File "D:\ComfyUI-aki-v1.2\python\lib\site-packages\cpm_kernels\library\base.py", line 72, in wrapper raise RuntimeError("Library %s is not initialized" % self.__name) RuntimeError: Library cudart is not initialized