gitingest icon indicating copy to clipboard operation
gitingest copied to clipboard

feat: include a token estimator utility

Open cyclotruc opened this issue 5 months ago • 2 comments

I think it could be interesting to have a small link in the footer that links to gitingest.com/tokencount in which you can paste text to get the token estimation for it

I'm not sure if this feature would be relevant in CLI, and in the Python package

Downside of CLI: would cause bloat in the arguments/options Downside of python module: users can just use tiktoken at this point

Let me know what you think and if wether this would be useful to you in CLI/python

cyclotruc avatar Jun 25 '25 03:06 cyclotruc

This seems like a small but thoughtful addition, happy to take it on. I’d implement a minimal frontend link in the footer pointing to gitingest.com/tokencount, with proper responsiveness and fallback behavior. For CLI or Python integration, I’d keep it opt-in (e.g. a lightweight --estimate-tokens flag or utility function) and avoid adding dependencies unless absolutely needed.

I’m actively working on agent prompt frameworks, so token efficiency is something I care about deeply. I’d love to make this utility cleaner and more visible for users across interfaces.

Let me know if there’s a preferred UI placement or analytics tag to include—I can get started right away.

HmbleCreator avatar Jun 29 '25 01:06 HmbleCreator

Hi @HmbleCreator thank you very much, you got the whole idea, you can go ahead!

I think the best first step would be to just have it in the front-end for now and not expose it to the CLI yet If anyone ever requests it in CLI, we can always expose it later

Let me know if you have any question

cyclotruc avatar Jun 29 '25 13:06 cyclotruc

Hi there! We haven’t seen activity here for 45 days, so I’m marking this issue as stale. If you’d like to keep it open, please leave a comment within 10 days. Thanks!

github-actions[bot] avatar Aug 28 '25 06:08 github-actions[bot]

Hi there! We haven’t heard anything for 10 days, so I’m closing this issue. Feel free to reopen if you’d like to continue the discussion. Thanks!

github-actions[bot] avatar Sep 11 '25 06:09 github-actions[bot]