NeMo-Guardrails
NeMo-Guardrails copied to clipboard
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
### Did you check docs and existing issues? - [x] I have read all the NeMo-Guardrails docs - [x] I have updated the package to the latest version before submitting...
I have a specific use case that would be enabled, but it doesn't support langchain and probably won't for the foreseeable future. It seems this has a hard dependency on...
Been testing out the strike.co Colang file under the Moderation Example, but been unable to trigger flows with more than one user input. For reference, I've modified the Colang file...
Hi, I was wondering if there was any way which rails can be enabled or disabled for flows. if there isn't, I believe that it may be helpful if rails...
Hi team! I was wondering if there is a specific function for setting Colang variables from the Python API? Similar to how we register actions with: ```python rails.register_action(action=action, name="name") ```
### Did you check the docs? - [x] I have read all the NeMo-Guardrails docs ### Is your feature request related to a problem? Please describe. Currently `Colang 2` does...
## Description AIPerf ([Github](https://github.com/ai-dynamo/aiperf), [Docs](https://docs.nvidia.com/nim/benchmarking/llm/latest/step-by-step.html)) is Nvidia's latest benchmarking tool for LLMs. It supports any OpenAI-compatible inference service and generates synthetic data loads, benchmarks, and all [metrics needed for comparison](https://docs.nvidia.com/nim/benchmarking/llm/latest/metrics.html)....
### Did you check the docs? - [x] I have read all the NeMo-Guardrails docs ### Is your feature request related to a problem? Please describe. nemoguardrails currently doesn't support...
for 0.19.0
## Description This PR modifies the existing `/v1/chat/completions` and adds a `/v1/models` endpoint to be OpenAI compatible. Changes: * `nemoguardrails/server/api.py` - Introduces new classes that correspond to OpenAI's standard chat...