AgentBench icon indicating copy to clipboard operation
AgentBench copied to clipboard

Revise Prompts to Comply with OpenAI API Policy

Open extreme1228 opened this issue 10 months ago • 0 comments

Title: Revise Prompts to Comply with OpenAI API Policy

Description:

Background

Recent updates to the OpenAI API have introduced stricter content filtering policies, causing some of our existing prompts (e.g., those containing "thought" or similar keywords) to trigger the filter and result in rejected requests. This impacts the functionality of [task/os 、 task/alfworld] by preventing successful API calls.

Changes

This pull request modifies the prompts in the following ways:

  • Removed or rephrased prompts containing "thought" or other flagged terms that trigger OpenAI's content filter (e.g., changed "Provide your thought process" to "Explain your reasoning").
  • Updated files:
    • AgentBench/src/server/tasks/os_interaction/task.py
    • AgentBench/src/server/tasks/alfworld/prompts/*
    • AgentBench/src/server/tasks/alfworld/task.py
  • Ensured the revised prompts maintain their original intent and functionality.

Impact

  • Prevents API requests from being blocked by OpenAI’s filter mechanism.
  • Maintains the quality and clarity of generated responses.
  • No significant performance or behavioral changes expected beyond filter avoidance.

Testing

  • Tested revised prompts in the environment; no filter triggers observed.

extreme1228 avatar Mar 04 '25 08:03 extreme1228