tonic_validate icon indicating copy to clipboard operation
tonic_validate copied to clipboard

Support fine-grained metrics

Open ghost opened this issue 1 year ago • 0 comments

Hello, could you please add support for more fine-grained metrics, possibly user-definable, like time to get embeddings, time to retrieve chunks from a vector database, time to get first bytes from streaming LLM etc.? That would give us a much better view of important metrics and possible regressions.

ghost avatar Apr 29 '24 15:04 ghost