Kibae Shin

Results 34 comments of Kibae Shin

Hi, @RudolfVonKrugstein You're right, there's no documentation for the TCP API yet. I created it to work with the [pg_onnx](https://github.com/kibae/pg_onnx) project, I didn't think anyone would use it. I'll try...

Hi, @kilievich-dmitriy-andreevich When attempting to run the ONNX session, you should send the following JSON as the post data: ```json { "images": [ // shape 1 [ // shape 3...

Hi @fullymiddleaged Thank you for your great suggestion! The output format of ONNX models can vary significantly. If the output were always a simple array like `[0.x, 0.x, 0.x]`, applying...

Hi, @fullymiddleaged Could you please attach the model if it's not too big? Also, could you give me some sample parameters for inference, I'll give it a try.

Hello, @fullymiddleaged :) I’ve written test code based on the ONNX file and the request you kindly provided. The shape of `input_ids` defined in the ONNX file was `(-1, -1)`....

Hi, @fullymiddleaged Thank you for your great suggestion. 👍 Since there could be multiple inputs, I believe option 2 might be a better approach than option 1. I’ll give it...

Hello. @xiaoyao9184 :) I understand your request. I will consider how to override the input shape when creating an ONNX session (POST `/api/sessions`). If you can offer any assistance or...

Hello, @xiaoyao9184 @fullymiddleaged Today, we released version 1.21.0. I've added `input_shape` and `output_shape` options to the `create session` request. These are optional parameters. By specifying these values, you can override...

Hi @fullymiddleaged :) Thanks for your good suggestion. I'll review it soon!

@jmealo Hello. Could you submit your improvement as a PR? Thank you.