semantic-kernel icon indicating copy to clipboard operation
semantic-kernel copied to clipboard

Improve Planner prompt to support invalid ASK

Open gogodjzhu opened this issue 2 years ago • 3 comments

It appears that the Microsoft.SemanticKernel.CoreSkills.SemanticFunctionConstants.FunctionFlowFunctionDefinition prompt always attempts to generate a plan for a given goal, even if there are no appropriate skills available to fulfill it. This can result in some absurd plans being generated.

To address this, there are two potential options:

  1. Return an error message when there are no suitable skills available to fulfill the goal. This would help prevent the generation of ridiculous plans and provide feedback to the user that the goal cannot be accomplished with the current set of skills.
  2. Leave the plan verification task to the user.

Thx.

gogodjzhu avatar Mar 26 '23 09:03 gogodjzhu

Thanks for the feedback -- you are right, this needs to be improved.

lemillermicrosoft avatar Mar 29 '23 17:03 lemillermicrosoft

Closing with PR now in main

evchaki avatar May 16 '23 20:05 evchaki

There is still additional work to be done. Opening this back up

evchaki avatar May 16 '23 21:05 evchaki