HPUedCSLearner

Results 7 comments of HPUedCSLearner
trafficstars

I meet the same perblem that cpp runner get diffrent output compare with python runner。 but I don`t know why

# I tried: ## case1: No error、but did not work ![image](https://github.com/openvinotoolkit/model_server/assets/35246483/4d21701f-232b-42c2-a348-6dbb9f2be9da) ## case2 ![image](https://github.com/openvinotoolkit/model_server/assets/35246483/a2a4463f-16d1-424d-b679-d1e804704b0e) ERROR: ``` /usr/local/lib/python3.10/dist-packages/transformers/utils/import_utils.py:521: FutureWarning: `is_torch_tpu_available` is deprecated and will be removed in 4.41.0. Please use the...

> Hi @HPUedCSLearner, `ignore_eos` as well as other text generation specific parameters are available via OpenAI API which is not supported via Python nodes. To use OpenAI API try: demo:...

I started with *[Quickstart](https://github.com/openvinotoolkit/model_server/blob/main/docs/llm/quickstart.md)* without making any changes, Here is the content of my graph.pbtxt: ``` input_stream: "HTTP_REQUEST_PAYLOAD:input" output_stream: "HTTP_RESPONSE_PAYLOAD:output" node: { name: "LLMExecutor" calculator: "HttpLLMCalculator" input_stream: "LOOPBACK:loopback" input_stream: "HTTP_REQUEST_PAYLOAD:input"...

> Could you share `graph.pbtxt`? Seems like the error is in parsing graph configuration. This is the content of my config.json and graph.pbtxt, please help me analyze what the configuration...

Thank you very much, it works。 But I have another problem, I will study it myself first。 And thank you again!!!