openinference icon indicating copy to clipboard operation
openinference copied to clipboard

[bug] possible missing langraph tokencounts

Open mikeldking opened this issue 1 year ago • 1 comments

Report of missing token counts using langraph

GPT and langgraph version==0.0.32. for referance you can see this collab https://colab.research.google.com/drive/1xDEPe2i_2rRqs7o6oNTtqA4J7Orsnvx1?usp=sharing

mikeldking avatar Jun 25 '24 13:06 mikeldking

I had a direct message conversation with the user. They are actually not using the same code as the one in the colab (the colab works fine and has token counts), but the user is using something that's calling the LLM with the streaming option and streaming doesn't return token counts in general.

RogerHYang avatar Jun 28 '24 19:06 RogerHYang