Unable to use dbrx-instruct for Q&A RAG

[satijapratik]

Hi,

I am using dbrx-instruct and dbrx-base through databricks serving endpoint to create a Q&A Conversation RAG chatbot. However, I am unable to generate a follow-up second response from the model when trying to incorporate Chat History. I am having issues alternating between the roles of user and AI when appending the chat history as a input to invoke the second question. Is there any documentation supporting this issue?

I have created two endpoints pointing to two separate models, dbrx-base and dbrx-instruct. However, whenever I try to incorporate chat history to these models, I get two different errors.

Here is the tutorial I am following: https://www.youtube.com/watch?v=PtO44wwqi0M

Here are the errors I got:

1. Error with dbrx-base:
2. Error with dbrx-instruct: