bedrock-claude-chat icon indicating copy to clipboard operation
bedrock-claude-chat copied to clipboard

[BUG] Chat Regenerate does not respect websocket preferences

Open ggallo opened this issue 6 months ago • 1 comments

Describe the bug

If you deploy with WS streaming disabled, requests to regenerate LLM responses will use WS regardless. This is a hazard for customers that need to deploy without WSS due to APIGW lack of private WS APIs.

To Reproduce

  1. Deploy v1.2.7 with VITE_APP_USE_STREAMING = false
  2. Start a conversation and wait for a response
  3. Click Regenerate
  4. Open devtools and notice the request to regenerate goes over WSS

Screenshots

Notice the initial POST, then multiple requests to regenerate are opening WSS connections image

ggallo avatar Jul 31 '24 01:07 ggallo