Kibae Shin
Kibae Shin
Hi, @RudolfVonKrugstein You're right, there's no documentation for the TCP API yet. I created it to work with the [pg_onnx](https://github.com/kibae/pg_onnx) project, I didn't think anyone would use it. I'll try...
Hi, @kilievich-dmitriy-andreevich When attempting to run the ONNX session, you should send the following JSON as the post data: ```json { "images": [ // shape 1 [ // shape 3...
Hi @fullymiddleaged Thank you for your great suggestion! The output format of ONNX models can vary significantly. If the output were always a simple array like `[0.x, 0.x, 0.x]`, applying...
Hi, @fullymiddleaged Could you please attach the model if it's not too big? Also, could you give me some sample parameters for inference, I'll give it a try.
Hello, @fullymiddleaged :) I’ve written test code based on the ONNX file and the request you kindly provided. The shape of `input_ids` defined in the ONNX file was `(-1, -1)`....
Hi, @fullymiddleaged Thank you for your great suggestion. 👍 Since there could be multiple inputs, I believe option 2 might be a better approach than option 1. I’ll give it...
Hello. @xiaoyao9184 :) I understand your request. I will consider how to override the input shape when creating an ONNX session (POST `/api/sessions`). If you can offer any assistance or...
Hello, @xiaoyao9184 @fullymiddleaged Today, we released version 1.21.0. I've added `input_shape` and `output_shape` options to the `create session` request. These are optional parameters. By specifying these values, you can override...
Hi @fullymiddleaged :) Thanks for your good suggestion. I'll review it soon!
@jmealo Hello. Could you submit your improvement as a PR? Thank you.