generative_agents
generative_agents copied to clipboard
Prompt is unclear what should be picked from a list of choices
First of all, this is a really fun and inspiring simulation, thank you for all the efforts making this great start.
After adapting the simulation to use a local LLM (llama.cpp), I have identified a potential issue about picking items from a list of objects or destinations.
For example, in the file action_location_object_vMar11.txt
, the part involving picking one of the locations from the list of areas was written like:
!<INPUT 3>! is !<INPUT 4>!. For !<INPUT 5>!, !<INPUT 6>! should go to the following area in !<INPUT 7>! (MUST pick one of {!<INPUT 8>!}):
With this, there is a chance the LLM would pick a more generic term out of these selections instead of the full name of the item. For example, with areas of ["man's bathroom", "woman's bathroom", "common room", "kitchen"]
, the LLM might just return "bathroom" instead of "man's bathroom" or "woman's bathroom".
To minimise the chance of this from happening, adding further clarifications like "a comma separated list" would encourage the LLM to return the full name of the item. For example:
!<INPUT 3>! is !<INPUT 4>!. For !<INPUT 5>!, !<INPUT 6>! should go to the following area in !<INPUT 7>! (MUST pick one item from this comma separated list {!<INPUT 8>!}. You must include all the words of that item.):