letta
letta copied to clipboard
Better error reporting in the CLI and API from LLM inference engine errors + visible retries in CLI
Is your feature request related to a problem? Please describe.
- Common errors and HTTP status messages should be properly passed back up the stack to the CLI or API server log error
- It is common for retries to happen in the initial message loop with bad LLMs, so the retry should be a visible print to stdout