autolabel
autolabel copied to clipboard
[Feature Request]: Augmenting heuristics/rule based labels with LLM labels
Is your feature request related to a problem? Please describe. We've had a few users share this feedback -- in some applications, it is helpful to augment LLM generated labels with programmatic rules/heuristics (lookup in a DB, keyword match, regex etc). Add support for this in Autolabel
Describe the solution you'd like A few different routes for us to consider here:
- Transforms -- this abstraction in Autolabel is in the works, but can support this feature
- Function calling/Plugins -- some LLMs like OpenAI (soon PaLM too) support function calling and the ability to call external APIs. in this way, rules can be more natively integrated into the LLM prompt.