lkk

## Type of Change add docstring API not changed

add trl example for mistral/mixtral.

5

# What does this PR do? add more training examples for trl-dpo, like MoE structure mistralai/Mixtral-8x7B-v0.1, mistralai/Mistral-7B-v0.1

lm-eval for llama.cpp enhancement.

2

## Type of Change enable lm-eval for llama.cpp models API not changed ## Description refer to the lm-eval [official code](https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/models/gguf.py) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python/tree/main) ### improvements: 1. load llama.cpp model directly when...

add mixtral trl sft

3

# What does this PR do? 1. add `pad_max` to pad inputs when sft with not packing, which is better for static shape 2. validate mixtral sft and add the...

[WIP] add gateway to GenAIExamples.

1

## Description move examples gateway implementation from GenAIComps to GenAIExamples