Pankaj Gupta
Pankaj Gupta
Load function runs on a separate thread, any processes created there die when the thread exits, which is immediately after the load function finishes. Some models such as those using...
Some commands such as run-examples require truss directory patch directly but some like predict require it passed as --target_directory. We should use the former everywhere to have a uniform interface.
Currently, if multiple python packages are added via live-reload, there's a possibility that some python requirements get installed while others fail. In such a case, since the truss container cannot...
The journey from the ml model to a serving model can be made even easier by generating deployment artifacts such as k8s deployment specs and helm charts. A k8s deployment...
Typical flow is like this: ``` handle = mk_truss(model, target_directory='some_dir') # Make changes to truss, like modify `model.py` # Recreate handle to load changes handle = from_directory('some_dir') ``` That last...
**Description** If one calls a live-reloadable truss when it's starting up for the first time, one sees a lot of 503 errors. This is the control proxy retrying while waiting...
It's better to stick to the semantic version schema as it's more intuitive to end users. The way to transition would be to have both py39 and 3.9 style versions...
If the size contribution of the control plane can be reduced to less than 100 MB, then it can just be bundled into all generated base images by default, cutting...
A tests directory under truss which has access to model code, bundled packages and external packages. To begin with, pytest can be used as the standard way of writing tests....
Truss eases turning raw models into services. Model Services normally shouldn't leak exception information into prediction error responses, but this can be useful during development. Baseten draft models are an...