Tyler Titsworth
Tyler Titsworth
I'm getting the same issue in my app. Chainlit offers a generic langchain provider that streams the model backend request provided by an llm input. When I add support for...
Issue was fixed in #15104
Assuming we are re-using the existing registration system, the model's archive file path would be stored in the registered model's metadata. As such, a deletion results in a check when...
``` github.event.merge_group.base_sha == github.event.pull_request.base.sha github.event.merge_group.head_sha == github.event.pull_request.head.sha ```
I saw the langroid implementation that achieves a similar result: https://github.com/langroid/langroid/blob/main/langroid/agent/callbacks/chainlit.py#L566
Before it gets asked here, yes I have tried to capture logs from within the deployed container, however the container does not even start so no other logs are recorded...
@agunapal In the build script I use to build this container I pull submodules (https://github.com/intel/ai-containers/blob/main/pytorch/serving/build-kfs.sh#L9) I am able to build the container, however, my issue is when it is deployed...
@agunapal any update on this? Is there any misunderstanding I can help alleviate?
This issue has been remediated with the latest version of torchserve