HPUedCSLearner
HPUedCSLearner
I meet the same perblem that cpp runner get diffrent output compare with python runner。 but I don`t know why
# I tried: ## case1: No error、but did not work  ## case2  ERROR: ``` /usr/local/lib/python3.10/dist-packages/transformers/utils/import_utils.py:521: FutureWarning: `is_torch_tpu_available` is deprecated and will be removed in 4.41.0. Please use the...
Thank you very much, I'll try it in a moment
> Hi @HPUedCSLearner, `ignore_eos` as well as other text generation specific parameters are available via OpenAI API which is not supported via Python nodes. To use OpenAI API try: demo:...
I started with *[Quickstart](https://github.com/openvinotoolkit/model_server/blob/main/docs/llm/quickstart.md)* without making any changes, Here is the content of my graph.pbtxt: ``` input_stream: "HTTP_REQUEST_PAYLOAD:input" output_stream: "HTTP_RESPONSE_PAYLOAD:output" node: { name: "LLMExecutor" calculator: "HttpLLMCalculator" input_stream: "LOOPBACK:loopback" input_stream: "HTTP_REQUEST_PAYLOAD:input"...
> Could you share `graph.pbtxt`? Seems like the error is in parsing graph configuration. This is the content of my config.json and graph.pbtxt, please help me analyze what the configuration...
Thank you very much, it works。 But I have another problem, I will study it myself first。 And thank you again!!!