Add: Truss for model serving

[philipkiely-baseten]

What is this Python project?

Truss is an open source model packaging framework for specifying a model server for an ML model from generative models like Mistral to data science models using tools like XGBoost.

What's the difference between this Python project and similar ones?

Truss is agnostic toward model serving engine (VLLM, TRT-LLM, TGI, etc), model framework (transformers, diffusors, data science frameworks like XGBoost), and i/o spec, offering substantial flexibility and interoperability with other open source tools. As a pure Python tool, it does not require local Docker like most model serving frameworks.

--

Anyone who agrees with this pull request could submit an Approve review to it.

[2361020362]

Si