NeMo-Guardrails icon indicating copy to clipboard operation
NeMo-Guardrails copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

How to integrate finetuned mistral model with NeMo-Guardrails

Open pradeepdev-1995 opened this issue 1 year ago • 1 comments

How to integrate PEFT finetuned mistral model located in my local directory with NeMo-Guardrails. Please share the example notebooks with sample yaml_content and colang_content

pradeepdev-1995 avatar Mar 12 '24 13:03 pradeepdev-1995

@pradeepdev-1995 : What are you using to serve the model? i.e., how are you testing, from python code? HuggingFacePipeline? vLLM? Ollama? etc.

drazvan avatar Mar 19 '24 10:03 drazvan

Closing it due to an extended period of inactivity.

Pouyanpi avatar Aug 20 '24 11:08 Pouyanpi