Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

CI failure tracker

Open Tcc0403 opened this issue 6 months ago • 4 comments

🐛 Describe the bug

Most failures are related to transformers VLM changes

unit test

qwen2vl_mrope

  • [x] test_qwen2vl_mrope https://github.com/linkedin/Liger-Kernel/pull/728

monkey patch

  • [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_mllama_for_conditional_generation https://github.com/linkedin/Liger-Kernel/pull/737
  • [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_gemma3 https://github.com/linkedin/Liger-Kernel/pull/735
  • [ ] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755
  • [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755

convergence test

VLM changes related #723 (config, video_processor, ...)

  • [x] llava https://github.com/linkedin/Liger-Kernel/pull/743
  • [x] qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738
  • [x] qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738
  • [x] gemma3 https://github.com/linkedin/Liger-Kernel/pull/735

_init_weights related (#739)

  • [x] olmo2 https://github.com/linkedin/Liger-Kernel/pull/741
  • [x] glm4 https://github.com/linkedin/Liger-Kernel/pull/741
  • [x] gemma1 https://github.com/linkedin/Liger-Kernel/pull/741
  • [x] gemma2 https://github.com/linkedin/Liger-Kernel/pull/741

logits numerical issue (#742)

  • [ ] gemma3
  • [ ] gemma
  • [ ] paligemma
  • [ ] paligemma2

Reproduce

No response

Versions

liger_kernel==https://github.com/linkedin/Liger-Kernel/commit/5d25e46827cd63210373d7a15641438b0bf36c66 trasnformers==4.52.3

Tcc0403 avatar May 26 '25 12:05 Tcc0403

@momochen @shimizust for visability.

lancerts avatar May 27 '25 00:05 lancerts

@Tcc0403 Thanks for doing the initial investigation. Can I help look into some of these? Which failures are you currently looking at?

shimizust avatar May 28 '25 19:05 shimizust

@shimizust Thanks for the help. I only checked the vlm related issues, haven't checked what caused the _init_weights errors.

Tcc0403 avatar May 29 '25 16:05 Tcc0403

#741 should fix all the _init_weights related errors

vaibhavjindal avatar Jun 02 '25 09:06 vaibhavjindal