client icon indicating copy to clipboard operation
client copied to clipboard

Python InferInput: set_data_from_numpy is not necessary in some cases.

Open RRoundTable opened this issue 3 years ago • 4 comments

Objective

In python, InferInput only support set_data_from_numpy. It means that users have to convert their data to numpy array even though it it not necessary.

So, I added an interface that can set raw_content without converting to numpy array.

Detail

When model in triton server can process data that has bytes datatype, User don't have to converting it to numpy array.

For example, if we use dali as preprocessor, dali can process bytes data.

RRoundTable avatar Nov 13 '22 12:11 RRoundTable

Hi @RRoundTable, thanks for making these changes. Can you fill out and email the CLA as described here?:

https://github.com/triton-inference-server/server/blob/main/CONTRIBUTING.md#contributor-license-agreement-cla

matthewkotila avatar Nov 17 '22 17:11 matthewkotila

Hi @RRoundTable, thanks for making these changes. Can you fill out and email the CLA as described here?:

https://github.com/triton-inference-server/server/blob/main/CONTRIBUTING.md#contributor-license-agreement-cla

Sorry. I checked late. I will fill out and email the CLA and let you know after that.

RRoundTable avatar Nov 25 '22 00:11 RRoundTable

@matthewkotila: Hi @RRoundTable, thanks for making these changes. Can you fill out and email the CLA as described here?: https://github.com/triton-inference-server/server/blob/main/CONTRIBUTING.md#contributor-license-agreement-cla

@RRoundTable: Sorry. I checked late. I will fill out and email the CLA and let you know after that.

No worries 🙏

matthewkotila avatar Nov 28 '22 17:11 matthewkotila

Hi. I send an email with CCLA. Thanks.

RRoundTable avatar Dec 02 '22 10:12 RRoundTable

@RRoundTable I see the PR was closed--do you still want to contribute these changes (or anything to the triton-inference-server organization)?

matthewkotila avatar Dec 30 '24 04:12 matthewkotila

@matthewkotila No I don't Thanks!

RRoundTable avatar Dec 30 '24 05:12 RRoundTable