Razvan Dinu

Currently, the system prompt is not forwarded as part of the chat history. If this is still relevant, I can point you to a work around using a context variable.

@cmpeburak: you can use `role` set to `context`, instead of `system` as shown below: ``` async def main(): result = await _generate_async( messages=[ {"role": "context", "content": {"system_prompt": DISCOVERY_CHAT}}, {"role": "user",...

@lauradang : this has to do with some unexpected side-effects from `nest_asyncio`. We don't have a workaround just yet. We'll followup on this.

@sidharthsingla-oa : we've not looked into this recently. Are you getting the same error? What's your setup / steps to reproduce?

And how exactly is the `NemoGuard` class used? I see the error stack involves `uvicorn`. Do you have a server that invokes `NemoGuard.validate` at some point? Also, can you paste...

The issue is here: ```diff def _get_name(): return "admin" - get_name = _get_name() app.register_action(action=get_name, name="get_name") ``` Because you're calling the `_get_name` function, you're actually registering a string (the returned value)...

In theory, nothing should block the multi-language use case. I'll follow up on this in a few days. Someone was able to have a bot respond in Japanese if I...

We're not actively developing this yet. We have done some internal testing in two directions: 1. Use translation in and out, and keep everything in English. 2. Define the canonical...

@guanjiahui: what's the exact issue?

@hww-rociorey: what model are you testing with?