litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard

Enable multi-turn prompts for supported LLMs

Open aniketmaurya opened this issue 1 year ago • 1 comments

Enable multi-turn prompts for the supported LLMs like Llama3, Mistral similar to https://github.com/Lightning-AI/litgpt/pull/1487

We should be able to do the following with other supported models:

style = Llama3()
msgs = [
        {"role": "system", "content": "You are a helpful AI assistant for travel tips and recommendations"},
        {"role": "user", "content": "What is France's capital?"},
        {"role": "assistant", "content": "Bonjour! The capital of France is Paris!"},
        {"role": "user", "content": "What can I do there?"},
    ]
multiturn_output = style.apply(msgs)

aniketmaurya avatar Jun 13 '24 10:06 aniketmaurya

Agreed. We planned this previously #1269 and can come back to it some time.

rasbt avatar Jun 13 '24 14:06 rasbt