NeMo-Guardrails icon indicating copy to clipboard operation
NeMo-Guardrails copied to clipboard

bug: Topical Rails making lot of embedding's calls, can we do it in a single call?

Open abhishekpandey3 opened this issue 7 months ago • 0 comments

Did you check docs and existing issues?

  • [x] I have read all the NeMo-Guardrails docs
  • [x] I have updated the package to the latest version before submitting this issue
  • [x] (optional) I have used the develop branch
  • [x] I have searched the existing issues of NeMo-Guardrails

Python version (python --version)

Python 3.11.9

Operating system/version

Windows 11

NeMo-Guardrails version (if you must use a specific version and not the latest

0.12.0

Describe the bug

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

Can it be optimized so that it makes only 1 embedding call.

Steps To Reproduce

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

Can it get optimized so that it makes only 1 embedding call.

Expected Behavior

Can it get optimized so that it makes only 1 embedding call.

Actual Behavior

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

abhishekpandey3 avatar Apr 17 '25 16:04 abhishekpandey3