autolabel icon indicating copy to clipboard operation
autolabel copied to clipboard

[Feature Request]: Augmenting heuristics/rule based labels with LLM labels

Open nihit opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe. We've had a few users share this feedback -- in some applications, it is helpful to augment LLM generated labels with programmatic rules/heuristics (lookup in a DB, keyword match, regex etc). Add support for this in Autolabel

Describe the solution you'd like A few different routes for us to consider here:

  1. Transforms -- this abstraction in Autolabel is in the works, but can support this feature
  2. Function calling/Plugins -- some LLMs like OpenAI (soon PaLM too) support function calling and the ability to call external APIs. in this way, rules can be more natively integrated into the LLM prompt.

nihit avatar Jul 18 '23 15:07 nihit