Question about OpenAI server behaviour

[Naman-ntc]

Hi, thanks for the implementation! We were planning to add this feature in zeno-build library as well (#132). I was curious how well do the OpenAI servers work in practice with respect to token count rate limit errors? I have found some unexpected rate limits on the token count side