use custom embedding and llm

[sampratha28]

I want to use custom embedding and custom llm (which are bascally API endpoints )to integrate with nemo guardrails. I already have it implemented in langchain. how do i use it with nemo guardrails?

[Pouyanpi]

Hi @sampratha28 ,

Have you followed the documentation? Specially you might find these documents helpful:

• Custom LLM
• Custom Embedding Search Provider

You can look at some example implementations here:

• Embedding Providers
• Custom LLM

Let me know if you need further assistance.

Thanks! Pouyan