phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

Published 20 hours ago • verified publisher icon Arize-ai

🗺️ Model Token count registry

Open mikeldking opened this issue 4 months ago • 1 comments

Need to register model token counts and tokenizes in a registry so that token counts can be computed

comprehensive list of when and when we do not have tokens:

  • 👎 llama-index with bedrock
  • ✅ llama-index with openai
  • ✅ llama-index with mistral

mikeldking avatar Mar 11 '24 15:03 mikeldking