Prithvi Kannan
Prithvi Kannan
@BenWilson2 totally agree we should add this! we would need to change a few places * UI: add a field for this, pass system prompt when making query * backend:...
Agreed this would be super useful. The existing components for this are largely already present: `make_metric()` to create an arbitrary EvaluationMetric and the deployment `client.predict()` to call LLM. We would...
> Howdy! Could you add some documentation of how this might be used? > > Because these are so lightweight, I actually think these will introduce more maintenance cost than...
> Great catch for chat models! Thoughts on: > > ``` > from mlflow.models.rag_signatures import StringResponse > > chain = llm | lambda x: StringResponse(text=x.content) > ``` > > for...