re-arch: Initial BudgetManager impl

[richbeales]

Background

Provides an initial basic implementation of the Budget / Constraint Manager for the re-architecture project. No-one had picked this up so I've given a draft. To be discussed/finessed before merging.

Changes

Flesh out the stub for BudgetManager.

Documentation

Not yet.

Test Plan

PR Quality Checklist

• [x] My pull request is atomic and focuses on a single change.
• [ ] I have thoroughly tested my changes with multiple different prompts.
• [ ] I have considered potential risks and mitigations for my changes.
• [ ] I have documented my changes clearly and comprehensively.
• [x] I have not snuck in any "extra" small tweaks changes

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
docs	⬜️ Ignored (Inspect)			May 7, 2023 7:01pm

[Boostrix]

FWIW, the generated prompt itself would probably also qualify as falling under "constraints", not in the financial/API sense, but in the token/chunking sense - and one that is different for people depending on the level of GPT access they've got ?

If the LLM were to be informed about the estimated costs of certain actions/commands, this could be internally used to benchmark/adapt as needed, i.e. favor actions/commands with less costs involved.

Here's a more detailed description of the idea:

• #3945

[github-actions[bot]]

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

[github-actions[bot]]

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.