[Feature Request] Official Rust Client Library for Triton Inference Server

[franklucky001]

Hello,

I would like to request an official Rust client library for Triton Inference Server. Currently, while there are client libraries for Python, C++, and Java, there isn't an official Rust binding, which makes it challenging to integrate Triton with Rust applications.

Current Situation

• The existing community-maintained Rust crates for Triton are either incomplete or difficult to use
• We need to manually handle the gRPC protocol and type conversions
• Lack of proper documentation and examples for Rust integration

Benefits of Having an Official Rust Client

1. Safety and Reliability: Rust's strong type system and memory safety guarantees would make the client more robust
2. Performance: Native Rust implementation could provide better performance
3. Better Developer Experience:
   • Type-safe API
   • Proper error handling
   • Idiomatic Rust interfaces
   • Comprehensive documentation
   • Official examples

Suggested Features

The Rust client library could include:

• gRPC and HTTP protocol support
• Async/await support
• Type-safe model inference
• Model management APIs
• Health monitoring
• Proper error types and handling
• Comprehensive examples
• Integration tests

Use Cases

• ML model serving in Rust applications
• High-performance inference services
• Edge computing applications
• Integration with Rust web services

Would the Triton team consider adding an official Rust client library to the project? I (and I believe many others in the Rust community) would be happy to contribute to this effort.

Thank you for considering this request.