NeMo-Guardrails

NeMo-Guardrails copied to clipboard

Bad responses on a longer conversation

3

@makeshn @trebedea The config file: instructions: - type: general content: | Below is a conversation between a bot and a user where the user asks the bot questions about a...

guanjiahui

How to return multiple output keys from chain action using Python API?

5

I am using the Python API model to integrate a chain I already have into a rail. this is an excerpt from my colang file ``` define flow default user...

donatoaz

jailbreak detection heuristics showing LLM calls even i specified length_per_perplexity_threshold and prefix_suffix_perplexity_threshold in config.yml

6

I am following the given notebook in the official NeMo-Guardrails repo https://github.com/NVIDIA/NeMo-Guardrails/tree/develop/docs/user_guides/jailbreak_detection_heuristics To avoid the LLM API calls for the jailbreak_detection , I am using the ```jailbreak_detection``` config as follows...

pradeepdev-1995

[Feature Request] Bedrock Embedding model

8

Hi, Bedrock has a couple of embedding models, in particular, "amazon.titan-embed-g1-text-02". I'd like to submit a feature request so that I can use this model: ```yaml models: - type: embeddings...

austinmw

I want to add Nemo Guardrail as layer on top of vLLM hosted LLM.

5

I want to add Nemo Guardrail as a layer on top of vLLM hosted LLM. That means, I need to replace openai model with my vLLM hosted LLM. One approahc...

SinhaPrateek

How to pass the history of messages to actions?

8

Hi team, In the custom action code that we write, we need a complete list of messages from a chat conversation. However, when I examine the three arguments passed to...

cmpeburak

Asyncio exception when initializing LLMRails inside function

5

I am running my FastAPI application via `uvicorn main:app --reload --host 0.0.0.0 --loop asyncio` via this bug fix: https://github.com/NVIDIA/NeMo-Guardrails/issues/112. However, I am running into another error when initializing `LLMRails` inside...

lauradang

Is NeMo-Guardrails works without LLM interaction for off topic checking?

9

I created the colang content like ``` colang_content = """ # define niceties define user express greeting "hello" "hi" "what's up?" define flow greeting user express greeting bot express greeting...

pradeepdev-1995

Bot Intent - Not Respond

3

HI I am experiencing issues with the bot choosing not to respond to items that it should. I hope below is enough information:) I am using a knowledge base with...

kinski76

TypeError: can only concatenate list (not "dict") to list

2

I have given the app.py file and config.yml(inside config folder) file as follows app.py ``` from nemoguardrails import RailsConfig, LLMRails config = RailsConfig.from_path("./config") rails = LLMRails(config) response = rails.generate(messages=[{ "role":...

pradeepdev-1995