bedrock-claude-chat icon indicating copy to clipboard operation
bedrock-claude-chat copied to clipboard

[BUG] Chat Regenerate does not respect websocket preferences

Open ggallo opened this issue 1 year ago • 1 comments

Describe the bug

If you deploy with WS streaming disabled, requests to regenerate LLM responses will use WS regardless. This is a hazard for customers that need to deploy without WSS due to APIGW lack of private WS APIs.

To Reproduce

  1. Deploy v1.2.7 with VITE_APP_USE_STREAMING = false
  2. Start a conversation and wait for a response
  3. Click Regenerate
  4. Open devtools and notice the request to regenerate goes over WSS

Screenshots

Notice the initial POST, then multiple requests to regenerate are opening WSS connections image

ggallo avatar Jul 31 '24 01:07 ggallo

@ggallo We'll make USE_STREAMING be deprecated because it's hard to maintain the option with keeping backward compatibility to add new features. Thank you for your understanding.

statefb avatar Aug 01 '24 01:08 statefb

This issue has been labeled as "stale" due to no response by the reporter within 1 month (and 14 days after last commented by someone). And it will be closed automatically 14 days later if not responded.

github-actions[bot] avatar Aug 31 '24 01:08 github-actions[bot]

This issue has been closed due to no response within 14 days after labeled as "stale", 14 days after last reopened, and 14 days after last commented.

github-actions[bot] avatar Sep 15 '24 01:09 github-actions[bot]