transformers-bloom-inference
transformers-bloom-inference copied to clipboard
When deploying the Bloom model, I noticed that the POST method is used for the generation task. Is it possible to modify it to perform question-answering instead?
After executing make gen-proto and make bloom-560m, I observed that the generated text is related to the input text. Is it possible to modify it to have a conversational style? If so, how can it be achieved?