autotrain-advanced icon indicating copy to clipboard operation
autotrain-advanced copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Liger kernel

Open jaume-ferrarons opened this issue 4 months ago • 4 comments

This PR adds support for Liger Kernel to enable lower training times and reduce memory usage.

It implements:

  • Validating liger-kernel is available.
  • Adds training liger-kernel parameter to llm finetuning tasks.
  • Switching to liger-kernel's model loader then installed, enabled by the user and the LLM's type is supported by liger-kernel.

jaume-ferrarons avatar Sep 26 '24 13:09 jaume-ferrarons