Simon Willison

Feature request: "view source" tool for inspecting package contents

11

The recent [event-stream problem ](https://medium.com/intrinsic/compromised-npm-package-event-stream-d47d08605502) on npm highlighted an issue that is also relevant to PyPI: even if a package links to a GitHub repository there is no guarantee that...

Documentation on using gunicorn and uv run

4

The https://otterwiki.com/Installation instructions currently lean towards "production" installations - Docker, Kubernetes, uwsgi. I wanted to try it out on my laptop with the least possible steps - it turns out...

Tools

7

Starting a new tracking issue for tool support, the next big LLM feature. Tools will be Python functions, LLM will provide an abstraction to get those to work against different...

Ability to specify fragment placement in templates

1

So you can construct a template that includes fragments at specific point within that template. Suggested https://mastodon.social/@webology/114387919299723272 > Where $1 might be the output from the first fragment, and $2...

`llm -f dir:directory` default fragment plugin

1

Effectively the same as `files-to-prompt` but as a default fragment plugin. Maybe even support this: ```bash llm -f dir:my-project,py+md ``` Which would mean "every `.py` and `.md` file in the...

Ability to calculate token-per-second speeds, including recording time to first token

7

Currently we record `duration_ms` and `input_tokens` and `output_tokens` but that's not quite enough. I'd like to start recording the time that the first token arrived too, that way we can...

Reconsider llm.Conversation in favor of allowing prompts to be in reply to responses

10

I was originally planning on implementing tools (#898) as part of `llm.Conversation` but I've been having second thoughts about that. There's a lot to be said for allowing prompts to...

Ability to "reply" to a tool-response with a prompt carrying those tool results

3

Part of tools, #898

Mechanism for adding tool definitions to a Prompt

3

First step in implementing tools, #898

Mechanism for attaching tool execution requests to a Response

2

Part of tools: #898