Open-Sora icon indicating copy to clipboard operation
Open-Sora copied to clipboard
verified publisher icon hpcaitech

Missing keys: ['pos_embed', 'pos_embed_temporal']

Open happy-jing opened this issue 1 year ago • 11 comments

[03/18/24 05:16:36] INFO colossalai - colossalai - INFO: /home/aiscuser/.conda/envs/opensora/lib/python3.10/site-packages/colossalai/initialize.py:6 7 launch INFO colossalai - colossalai - INFO: Distributed environment is initialized, world size: 1 ./pretrained_models/t5_ckpts/t5-v1_1-xxl Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████| 2/2 [00:24<00:00, 12.07s/it] Missing keys: ['pos_embed', 'pos_embed_temporal'] Unexpected keys: []

happy-jing avatar Mar 18 '24 12:03 happy-jing

What is the cuda version of your machine? I also encountered the same problem.

QQQTAO avatar Mar 19 '24 06:03 QQQTAO

What is the cuda version of your machine? I also encountered the same problem.

12.0

happy-jing avatar Mar 19 '24 06:03 happy-jing

What is the cuda version of your machine? I also encountered the same problem.

12.0

I did not debug and ran it directly using the command. Have you debugged it?

QQQTAO avatar Mar 19 '24 06:03 QQQTAO

What is the cuda version of your machine? I also encountered the same problem.

12.0

I did not debug and ran it directly using the command. Have you debugged it?

No. I ran it directly using the command too. I have no idea how to debug

happy-jing avatar Mar 19 '24 07:03 happy-jing

同样问题

aguang1201 avatar Mar 19 '24 08:03 aguang1201

The same Q. It drives me crazy! What a difficult project to reproduce!

Jianrong-Lu avatar Mar 19 '24 13:03 Jianrong-Lu

The same Q. It drives me crazy! What a difficult project to reproduce!

这个不是bug，代码里有输出Missing keys: ['pos_embed', 'pos_embed_temporal']的语句

Jianrong-Lu avatar Mar 19 '24 13:03 Jianrong-Lu

The same

whk6688 avatar Mar 29 '24 05:03 whk6688

Have anyone solved this problem?

Michi-3000 avatar Apr 04 '24 13:04 Michi-3000

Have anyone solved this problem?

别看中文的介绍，他写错了。 看英文的

whk6688 avatar Apr 07 '24 02:04 whk6688

Both the pos_emd are not learnable. Hence it is expected that they are not in the saved checkpoints.

jinhuaca avatar Apr 12 '24 11:04 jinhuaca

[03/18/24 05:16:36] INFO colossalai - colossalai - INFO: /home/aiscuser/.conda/envs/opensora/lib/python3.10/site-packages/colossalai/initialize.py:6 7 launch INFO colossalai - colossalai - INFO: Distributed environment is initialized, world size: 1 ./pretrained_models/t5_ckpts/t5-v1_1-xxl Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████| 2/2 [00:24<00:00, 12.07s/it] Missing keys: ['pos_embed', 'pos_embed_temporal'] Unexpected keys: []

No worry. This is not an error and is expected. So just ignore this.

zhengzangw avatar May 10 '24 07:05 zhengzangw