Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

[Model] Pixtral Support

Open AndreSlavescu opened this issue 1 year ago • 4 comments
trafficstars

Summary

This PR aims to support pixtral

Testing Done

tested model + tested monkey patch

  • Hardware Type: 3090
  • [x] run make test to ensure correctness
  • [x] run make checkstyle to ensure code style
  • [x] run make test-convergence to ensure convergence

AndreSlavescu avatar Sep 18 '24 05:09 AndreSlavescu

Pixtral isn't yet fully supported in transformers library. PR pending release of Pixtral in transformers package.

AndreSlavescu avatar Sep 18 '24 05:09 AndreSlavescu

Exciting! @AndreSlavescu seems it is now supported in the transformer https://github.com/huggingface/transformers/tree/main/src/transformers/models/pixtral, do you mind update the PR?

lancerts avatar Oct 03 '24 14:10 lancerts

Exciting! @AndreSlavescu seems it is now supported in the transformer https://github.com/huggingface/transformers/tree/main/src/transformers/models/pixtral, do you mind update the PR?

yes, I'll try to finish this either today or tomorrow

AndreSlavescu avatar Oct 03 '24 17:10 AndreSlavescu

@Tcc0403 pinging If you'd like to take a look.

AndreSlavescu avatar May 27 '25 03:05 AndreSlavescu

Sorry, I wonder when to support the Pixtral.

cxmscb avatar Jul 19 '25 23:07 cxmscb