QLutz

Nose version: 1.3.7 Python: 3.6 OS: Xenial Hi, We are having an issue highly reminiscent of [this one](https://github.com/nose-devs/nose/issues/92) when using the doctest flag. Adding said flag results in issues (not...

Hello and thanks for the awesome library ! I'd like to reproduce some of the results you display in the repo's README and had a few questions: 1. I was...

Adapter support

1

### Feature request Enable the use of locally stored adapters as created by huggingface/peft. Ideally, this should be compatible with the most notable benefits of TGI (e.g. sharing and flash...

bug: Built runner has no default mapping

1

### Describe the bug Thanks for the last release ! It really delivers a lot of amazing features ! The problem I have occurs when building a runner using the...

feat(build): support absolute adapter path

3

### Describe the bug Trying to build a Bento from a LLaMa 13B model with a locally stored adapter, it appears some package is missing. ### To reproduce `openllm build...

Support for UMT5

2

New UMT5 models from Google are currently the most interesting variation of the original T5s. However, trying to convert a UMT5 model using the transformers converter by running: `ct2-transformers-converter --model...

Queue size increases indefinitely

2

### System Info OS version: Linux Model being used (curl 127.0.0.1:8080/info | jq): TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ Hardware used (GPUs, how many, on which cloud) (nvidia-smi): 1xL40S The current version being used: 2.0.4...