chatbox icon indicating copy to clipboard operation
chatbox copied to clipboard

[BUG] System messages don't seem to work

Open mmiddlezong opened this issue 1 year ago • 2 comments

Bug Description When providing a system message stating "Only respond with the code. Do not provide an explanation unless it is specifically asked for," gpt-4-turbo still attempts to explain the code. This contrasts with behavior obtained by calling the OpenAI API directly; in that case, gpt-4-turbo successfully avoids giving an explanation and only provides code.

Steps to Reproduce Please provide the steps to reproduce the bug:

  1. Configure the app to use gpt-4-turbo on default settings
  2. Click on "New Chat"
  3. Edit the system message to: "Only respond with the code. Do not provide an explanation unless it is specifically asked for." or something similar.
  4. Click SAVE.
  5. Type in the message, "Give me React code for a login form"
  6. Observe

Expected Results The bot should respond with only the code, with brief or no explanation. This is the behavior seen with other chatbot GUIs and the OpenAI API itself.

Actual Results The bot provides a lengthy explanation of the code.

Screenshots image image

Desktop (please complete the following information):

  • Operating System: macOS
  • Application Version: 1.3.5

mmiddlezong avatar Apr 22 '24 23:04 mmiddlezong

I have also unfortunately noticed system messages not working. It would be awesome to have it.

EarNugget avatar Apr 25 '24 19:04 EarNugget

Using the model gpt-4 seems to have system messages working, but gpt-4-turbo does not.

mmiddlezong avatar Apr 26 '24 12:04 mmiddlezong

This was caused by a bug, which I have fixed in version 1.3.6.

Bin-Huang avatar May 05 '24 03:05 Bin-Huang