Sanketh Gadadinni

@aarnphm I think with dtype float16 it should work. What about LLama?

@aarnphm No even LLama isn't working. bfloat16 is default.

 When I'm running the example, the second user request isn't getting the context from previous.