griptape
griptape copied to clipboard
Add before and after hooks for masking data in prompts
Some users would like to mask and unmask data that goes out to external APIs as part the LLM prompt (e.g., customer PII). To solve this problem I propose adding the following to the framework:
- Add
BasePromptStackProcessorclass that containsbefore_runandafter_runmethods. Let's think of better names. - Add
prompt_stack_processors: list[PromptStackProcessork]property that contains a list of optional prompt stack processors. - Run
PromptStackProcessor.before_runinBasePromptDriver.before_runand PromptStackProcessor.after_runinBasePromptDriver.after_run` in all prompt processors. - Add
AmazonComprehendPiiProcessorthat uses Amazon Comprehend to filter out PII data. - Add
PromptDriverPiiProcessorthat can use an arbitrary prompt driver to filter out PII data.
can I work on this?