FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard
verified publisher icon FlagOpen

Liger kernel support

Open ccdv-ai opened this issue 10 months ago • 1 comments

Is liger kernel supported? Liger kernel can increase training throughput (+20%) and significantly reduce memory usage (-60%).

ccdv-ai avatar Mar 09 '25 14:03 ccdv-ai

Hello, @ccdv-ai. Liger kernel is not currently supported. We will consider adding support for this feature in FlagEmbedding, and we also welcome the contributions from the community!

hanhainebula avatar Apr 10 '25 09:04 hanhainebula