optimum-habana icon indicating copy to clipboard operation
optimum-habana copied to clipboard

add mixtral trl sft

Open lkk12014402 opened this issue 5 months ago • 3 comments

What does this PR do?

  1. add pad_max to pad inputs when sft with not packing, which is better for static shape
  2. validate mixtral sft and add the training command
  3. validate mistral dpo pipeline

lkk12014402 avatar Sep 21 '24 13:09 lkk12014402