claude-coder icon indicating copy to clipboard operation
claude-coder copied to clipboard

Update context window algorithm token count

Open matannahmani opened this issue 1 year ago • 0 comments

  • Currently, context window algorithm is a bit off, currently anthropic doesn't have a public tokenizer but we can assume every letters is one token

matannahmani avatar Oct 14 '24 01:10 matannahmani