timothelaborie

LISA

7

### Feature request Suggestion: Add a "use_lisa" parameter to use [this](https://arxiv.org/abs/2403.17919) ### Motivation It's better than LoRA ### Your contribution There is an implementation [here](https://github.com/OptimalScale/LMFlow/blob/be2c49c6a17ba43c6c9010a85cc63840102463c2/src/lmflow/pipeline/finetuner.py#L300)

support for openrouter.ai

1

There are many models here: https://openrouter.ai/docs#models Can we add support for this? There is already a page where the user can add their API key for petals, so there could...

OpenAI added logprobs for the GPT-4 API (and other chat models) In the [playground](https://platform.openai.com/playground?mode=complete&model=gpt-3.5-turbo-instruct), you can turn on "show probabilities", and then you can highlight a token in the text...

Loading a BNB 4 bit model + adapter

1

After doing QLoRA with a training library (unsloth) and saving the adapter, is there a way to load the 4 bit bnb model and the un-merged adapter for use with...