llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Use inference APIs for executing Llama Guard

Open ashwinb opened this issue 1 year ago • 0 comments

We should use Inference APIs to execute Llama Guard instead of directly needing to use HuggingFace APIs. The actual inference consideration is handled by Inference.

ashwinb avatar Sep 26 '24 21:09 ashwinb