tensorzero
tensorzero copied to clipboard
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.
Closes #127 Don't merge until #394 is merged.
For example: labeler name for demonstrations, synthetic data algorithm, customer ID
This should be a variant type that generates an output based on many candidate solutions without being constrained to selecting one as in best-of-n. Will be useful for beam search...
3 options to fix: 1. add a check that if the model being called is Anthropic then we use ImplicitTool. 2. Make JSON model default to ImplicitTool for Anthropic 3....
https://docs.fireworks.ai/fine-tuning/fine-tuning-via-api
Right now the data on ClickHouse requires the config file to reconstruct the original inference and so on. Maybe we should add enough data to ClickHouse to make entries self-sufficient.