langkit
langkit copied to clipboard
whylabs
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance me...
Uses proposed schema chaining [1380](https://github.com/whylabs/whylogs/pull/1380) to support a schema per language for each metric module. Multiple languages can be selected when initializing a metric collection. Metrics are prefixed with the...
https://github.com/whylabs/langkit/blob/dfe9afb8ceb75799f855aff9902d46fbd96d8195/langkit/whylogs/example_utils/guardrails_example_utils.py#L58C1-L59C1 it's confusing when tryig to reuse it
Multilingual is "must have" feature for prod deployment for most international companies , any plan to support it for modules ? For example , perspective api supports multilingual https://developers.perspectiveapi.com/s/about-the-api-attributes-and-languages?language=en_US The...
The addresses regexes could be expanded to match additional terms, like: place, pl, plaza, plz, unit, apt, apartment, #, terrace, circle. etc. And another group that might be helpful is...
Description.md's Usage section could use some links to docs where they reference UDFs.
Some UDFs depend on specific columns or multiple columns specified by names, e.g. ```response.relevance_to_prompt``` will be missing if a message is logged that contains only a 'prompt' which can be...
It could be useful for langkit to emit DevOps-y metrics with OpenTelemetry
https://github.com/whylabs/langkit/pull/50
