Agent Request Throttling

[greysonlalonde]

@joaomdmoura API throttling per agent is frequently mentioned in issues. Is there space on the roadmap to address this, and if so, mind if I start on it?

[mindwellsolutions]

@greysonlalonde This would be amazing! Utilizing 2 simple variables when defining the agent would work well:

completed_successful_requests_perminute = 59 # This will track how many API Requests have been completed tokens_processed_perminute = 500 # If possible, the ability to limit the amount of tokens it will process in per minute or per task.

[joaomdmoura]

Done, merged in main, will cut a new version tomorrow and add docs