Rangehow

Hi, @yzh119 . It seems the problem needs more attention since a lot of people also encounter this. The reply you provided suggests a method for checking, but the results...

> I didn't see this PR until now, yesterday I ended up adding `tqdm` to every task so that all the progress bars were available by default. Happy to help...

@gusye1234 cc

https://github.com/stanfordnlp/dspy/blob/cc96b7a61375ebddc9896245e10b96cb49e2e27c/dspy/adapters/chat_adapter.py#L47 `[(None, 'answer: American'), ('completed', '')]`

> Hey @rangehow ! Thanks for opening this.嘿 ！感谢您打开这个。 > > What is `openai/default`? What LM is this connecting to? It seems like that LM fails to respect the output...

> Thanks for the report, what results do you get if you extract your `custom_http_client` & `openai_async_client` outside of the async function call so they're singletons? Do you mean this?...

I didn’t complete the entire run, but I think the result should still be the same as last time. 

This framework is fast, but it prioritizes speed over accuracy. If you can accept an accuracy of 1e-2, you can use it, but otherwise, more consideration is needed. Tensors starting...

> thanks, does this still happen if you just use `httpx` to make the requests instead of the `openai` SDK? Honestly, I don’t really understand network programming—it’s a bit beyond...

Although the concurrency didn’t hit the full load of 1024, it seems that the singleton operations have clearly increased the overall concurrency!