Philipp Schmid

LLaMA 2 support for pre-training

6

Hello, Are you planning to add support for LLaMA 2 to further pretrain the models?

Integrate Weights and Biases (wandb) for logging.

8

Hi, when i train models i often use [https://www.wandb.com/](https://www.wandb.com/) to track my hyperparameter and results of my training. I think it's an awesome tool to keep track of what you...

Maintance and improvements

6

@mdrokz are you planning to main this project? I saw it uses a pretty old llama.cpp version.

### System Info ghcr.io/huggingface/text-generation-inference:2.0.2 ### Information - [X] Docker - [ ] The CLI directly ### Tasks - [X] An officially supported command - [ ] My own modifications ###...

### System Info ghcr.io/huggingface/text-generation-inference:2.0.2 ### Information - [X] Docker - [ ] The CLI directly ### Tasks - [X] An officially supported command - [ ] My own modifications ###...

Hugging Face support

2

### Describe the feature Hello, Here is Philipp from Hugging Face. I am leading the partnership between AWS and Hugging Face from a technical side. I just came across this...

Add support for PDFs as "clip" input.

Add Hugging face client

2

# What does this PR do? This PR adds a dedicated Hugging Face client, which allows `llmperf` user to benchmark Hugging Face models using TGI on the API inference, Inference...