transformers-bloom-inference icon indicating copy to clipboard operation
transformers-bloom-inference copied to clipboard

When deploying the Bloom model, I noticed that the POST method is used for the generation task. Is it possible to modify it to perform question-answering instead?

Open dizhenx opened this issue 1 year ago • 0 comments

After executing make gen-proto and make bloom-560m, I observed that the generated text is related to the input text. Is it possible to modify it to have a conversational style? If so, how can it be achieved?

dizhenx avatar Jun 05 '23 02:06 dizhenx