sublayer icon indicating copy to clipboard operation
sublayer copied to clipboard

Better, more streamlined way to test agents

Open swerner opened this issue 1 year ago • 0 comments

Bringing this discussion here from the discord. Talking a bunch lately about what testing an agent looks like and there are lots of pitfalls and things you have to stub to effectively be able to test your agent. If you miss one, like stubbing sleep, your tests will just hang.

Conversation in discord brought up this idea of "dry run" which would be interesting - basically creating a list of steps the agent would take if running in the real world.

Still likely need some way to handle integration-like tests to make sure everything connects.

swerner avatar Aug 13 '24 14:08 swerner