autolabel
autolabel copied to clipboard
refuel-ai
Label, clean and enrich text datasets with LLMs.
# Pull Review Summary ## Description Handling empty generations returned by Gemini 1.5 Pro API ## Type of change - Bug fix (change which fixes an issue) ## Tests
# Pull Review Summary ## Description This is a WIP PR. Deprecating support for RefuelLLM. RefuelLLM-2's interface is the same as other models, so simplifying all our codepaths accordingly. ##...
# Pull Review Summary ## Description Return LLM annotations with metrics for explanation generation optionally. ## Type of change - New feature (change which adds functionality) ## Tests Tested locally
**Is your feature request related to a problem? Please describe.** When asking the model to predict true/false or MCQ, a confidence score and probability distribution are not enough for the...
# Pull Review Summary ## Description Support for multilabel refuel LLM confidence. Still requires a change to how logprobs are returned from refuel LLM ## Type of change - Bug...
# Pull Review Summary ## Description Return LLM examples in annotation object ## Type of change - New feature (change which adds functionality) ## Tests Tested locally