Feature: Prompt Management Webhooks

[hongkongkiwi]

Feature request

I would like the ability to run a webhook when a prompt is changed. In this case I'd like to download the prompt to a local cache so we don't have to hit he langsmith webapi to get the latest prompt every time.

Webhook capability is already setup for runs, but I'd like the same kind of functionality for prompt.

Ideally I should be able to setup a webhook for the following events:

• Prompt Added (or forked)
• Prompt Deleted
• Prompt Commit

Motivation

I'd like to keep a local cache of prompts locally so we don't need to hit the webapi for every single request.

Additionally I'd like to judge the prompt and recommend improvements automatically when a prompt is added or updated.

[mathg]

I was exactly looking for this feature at the moment, too bad it doesn't exist, but I second this feature request. Would greatly help to keep prompts in an external cache and only clear when needed instead of having to rely on TTL.

[tanushree-sharma]

@madams0013 is going to be picking up the work for this very soon!

[madams0013]

We've shipped the ability to add webhooks on prompt commit -- here's a tutorial for how to set up syncing with GitHub! https://docs.smith.langchain.com/prompt_engineering/tutorials/prompt_commit