eliza icon indicating copy to clipboard operation
eliza copied to clipboard

[Request] Feature : Response Format

Open brij2001-hof opened this issue 11 months ago • 2 comments

Is your feature request related to a problem? Please describe.

Can we implement structured response or response_format defined in a JSON like : https://platform.openai.com/docs/guides/structured-outputs

Describe the solution you'd like

A parameter in the settings dict of the character that implements JSON structured response.

Describe alternatives you've considered

Have tried to describe in bio of the character using prompts but quantized(GGUF) models output gibberish sometimes.

Additional context

I am using LM studio as the OpenAi server and it can give out a structured response to all requests. But that is the problem, agents not requiring JSON output will also follow the instructions which doesn't help if using same local endpoint for multiple agents.

brij2001-hof avatar Jan 10 '25 12:01 brij2001-hof

Hello @brij2001-hof! Welcome to the ai16z community. Thank you for opening your first issue; we appreciate your contribution. You are now a ai16z contributor!

github-actions[bot] avatar Jan 10 '25 12:01 github-actions[bot]

I would have thought use the templates? Even Eliza herself agrees Screenshot_20250112-040350.png

This is the initial message: https://eliza.gg/search?q=Can%20we%20implement%20structured%20response%20or%20response_format%20defined%20in%20a%20JSON%20like%20:%20https://platform.openai.com/docs/guides/structured-outputsDescribe%20the%20solution%20you%27d%20likeA%20parameter%20in%20the%20settings%20dict%20of%20the%20character%20that%20implements%20JSON%20structured%20response.Describe%20alternatives%20you%27ve%20consideredHave%20tried%20to%20describe%20in%20bio%20of%20the%20character%20using%20prompts%20but%20quantized(GGUF)%20models%20output%20gibberish%20sometimes.Additional%20contextI%20am%20using%20LM%20studio%20as%20the%20OpenAi%20server%20and%20it%20can%20give%20out%20a%20structured%20response%20to%20all%20requests.%20But%20that%20is%20the%20problem,%20agents%20not%20requiring%20JSON%20output%20will%20also%20follow%20the%20instructions%20which%20doesn%27t%20help%20if%20using%20same%20local%20endpoint%20for%20multiple%20agents

ggindev avatar Jan 12 '25 04:01 ggindev

This issue has been automatically marked as stale due to 30 days of inactivity. If no further activity occurs within 7 days, it will be closed automatically. Please take action if this issue is still relevant.

github-actions[bot] avatar Feb 11 '25 18:02 github-actions[bot]