CLEAR

CLEAR copied to clipboard

报错RuntimeError: The size of tensor a (4608) must match the size of tensor b (16896) at non-singleton dimension 2

1

Traceback (most recent call last): [rank2]: File "/data/hanrui/CLEAR/distill.py", line 1245, in [rank2]: main(args) [rank2]: File "/data/hanrui/CLEAR/distill.py", line 1028, in main [rank2]: teacher_pred = transformer_teacher( [rank2]: File "/data/hanrui/conda/pytorch/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1751, in...

hanhanhanhanhan929

蒸馏过程是否是必要的

1

Q只和对应圆形范围内的KV相乘 这个过程是一定要train吗？ 如果直接infer结果会不会也有差不多的效果？

kxding

Error when training the proposed method

4

I follow the steps shown in the repo to set up the conda environment, and then execute distill.sh on A100. It raises the following error: ``` Traceback (most recent call...

syf-fgnb

把原有的注意力机制统统换成q不变，kv圆形区域内？新的网络和老师网络蒸馏方法训练？

9

请问理解对吗？

henbucuoshanghai

Synthetic Dataset

3

Hi, the synthetic dataset-10K is very suitable for flux distillation. Would you mind sharing how to select/get the text prompts in the dataset? Thanks.

A-BigBao

How to reproduce the 6 times speed up reported in the paper?

1

Dear authors, Thank you for open-sourcing your work. I am wondering how to exactly reproduce the 6 times speed up under 8K resolution reported in Fig 2?

jzhang38

Can this method be trained on images with non-1:1 resolution.

1

Thanks to open source for this wonderful work. I have a question if this method is only supporting 1:1 resolution (e.g. 1024*1024) images for training. What do I need to...

super782

Speedup should be much more than 6.3x on 8K resolution?

1

Hi, Thanks for your great work! I have one question, from table 7, for the 8K resolution, the TFLOPS reduced from 847.73 to 3.92, but why the overall speedup is...

sjtuzq

Have you considered implementing it in ComfyUI?

3

sungod189

Inference error

1

Hi @Huage001 , I make `inference_t2i.ipnyb` to .py file (code is exactly the same), and try to test the acceleration in flux dev, I meet the error in pipe inference...

phyllispeng123