llm
llm copied to clipboard
simonw
Access large language models from the command-line
use the AzureOpenAI class for the azure api, because since openai>1.0…0 the openai python package uses a different class when using the azure openai api this is just a preliminary...
https://click.palletsprojects.com/en/8.1.x/documentation/#help-parameter-customization
Without `model_name` llm crashes. Today OpenAI released gpt-4-turbo-2024-04-09 and gpt-4-turbo is pointing to it but without adding a custom model to the config it's not possible to use it. From...
When I use some OpenAI-compatible LLM plugins, this kind of error occurs because some APIs do not support this parameter `logprobs`. However, when making the judgment here, it seems that...
I'm getting this error on a fresh install, and I'm not sure what's causing it: ``` $ llm "hello" Hello! How can I assist you today? Traceback (most recent call...
I want to see logs just of prompts run by the tool I describe here: https://til.simonwillison.net/llms/claude-hacker-news-themes It shells out to LLM. It would be neat if it could do this:...
Sorry but I cannot find solutions to this. Hope this problem won't waste your guys' time. my question is： my `extra-openai-models.yaml` under the project root folder looks like: ``` -...
Have you considered using prompt-toolkit for the interactive chat mode? It would work much better than what you're currently using, especially for multiline prompts.
All dollar signs in a template's `prompt` or `system` values are interpreted as introducing `placeholders`. The documentation for `string.Template` says that doubling a dollar sign should escape it. Due to...
Is there a way to set options in a template? Use case: I wrote a template to output code to the command line, usually a very low temperature is used...
