BambooAI icon indicating copy to clipboard operation
BambooAI copied to clipboard

No feeback for the user while correcting code

Open pnmartinez opened this issue 2 months ago • 1 comments

Problem

When code corrections are triggered, the user is left waiting without any feedback on CLI about current status of the process (image below).

Solution

Output from the LLMs while correcting the code in between corrections would prevent the user from thinking the process has halted or crashed (green region in image below).

This is particularly troublesome doing inference on slow setups (such as local LLMs on laptops, like Llama3 8b).

imagen

pnmartinez avatar May 03 '24 15:05 pnmartinez