autogen icon indicating copy to clipboard operation
autogen copied to clipboard

Chat History Reduction

Open BenConstable9 opened this issue 1 year ago • 3 comments

What feature would you like to be added?

I would like the ability for agents to only read chat history from select other agents or the last n messages.

Certain agents might only need the history from other select agents (in more of a process flow)

Certain agents might only need access to the last N messages.

Why is this needed?

Currently, long running group chats can consume a significant number of tokens.

BenConstable9 avatar Dec 10 '24 22:12 BenConstable9

This would be a nice feature. It would help to have a mock of a concrete use case.

gagb avatar Dec 10 '24 22:12 gagb

This is related to #4438. I believe we can meet this requirement with a simple implementation of memory.

ekzhu avatar Dec 12 '24 00:12 ekzhu

@BenConstable9 meanwhile at the Core API, you can take a look at ModelContext module https://microsoft.github.io/autogen/dev/reference/python/autogen_core.model_context.html for some basic functionalities.

ekzhu avatar Dec 12 '24 00:12 ekzhu

When are we planning to release the agent conversation having memory or state enabled, to make sure in one session it works like a chat experince and carry the context ?

KanikaChoudhary1312 avatar Mar 19 '25 15:03 KanikaChoudhary1312

It is already the case. Agents maintains state. For saving and loading: https://microsoft.github.io/autogen/dev/user-guide/agentchat-user-guide/tutorial/state.html

ekzhu avatar Mar 20 '25 08:03 ekzhu