PawelFaron

Please provide working code that can reproduce this issue.

@Lothiraldan Just give the callbacks to run: ``` print("LOAD TOOLS!") tools = load_tools(["terminal"]) print(tools[0].run({"commands": ["echo 'Hello World!'", "time"]}, callbacks=[MyCustomHandler()])) ```

@Lothiraldan Not sure if this can be a workaround for you: ``` print("LOAD TOOLS!") tools = load_tools(["terminal"]) tools[0].callbacks = [MyCustomHandler()] print(tools[0].run({"commands": ["echo 'Hello World!'", "time"]})) ``` The problem is that...

For some other cases you can pass the CallbackManager as load_tools take it and use it in some casees ``` manager = CallbackManager([MyCustomHandler()]) tools = load_tools(["terminal"], callback_manager=manager) ```

Please provide working code that can reproduce this issue.

I will try to add multithreading for it.

Please provide working code that can reproduce this issue.

Please provide working code that can reproduce this issue.

Would ge great to have. best_of is great but way to slow. With best_of=1 I have **_time_per_token="92.055402ms"_** With best_of=2 I have **_time_per_token="307.8662ms"_**

@Narsil Thanks for your response. Probably you are right, just saying my observations so far. The timing is from the docker container itself. It prints that after it generates text....