Jing Xu

ICL相关实现

1

请问ICL的相关实现要怎么做呢，没有在代码里面找到相关的信息

long prompt evaluation

1

I am using the augment's long prompt for evaluation. Since the prompt is too long, I'm using the corresponding short prompt as the filename. When conducting the evaluation, should I...

asynchronous inference with teacache

1

Question 1: When using asynchronous inference with TeaCache, the output video quality is very poor. May I ask if the two features are incompatible? ` model_id="SkyReels-V2/SkyReels-V2-DF-1.3B-540P" python3 generate_video_df.py \ --model_id...

Sidestep NaN caused by div by zero where calculated scale == 0

12

I'm trying to quantize the Qwen2-57B-A14B model using the following configuration: ``` pretrained_model_id = "/mnt/82_store/xj/modelzoo/qwen/Qwen/Qwen2-57B-A14B" quantized_model_id = "/mnt/82_store/xj/GPTQModel/quantmodel/Qwen2-57B-A14B-2bit-128g-c4 calibration_dataset = load_dataset( "allenai/c4", data_files="en/c4-train.00001-of-01024.json.gz", split="train" ).select(range(1024))["text"] quantize_config = QuantizeConfig( bits=2, group_size=128,...