tiktoken topic
chatgpt-long-term-memory
The ChatGPT Long Term Memory package is a powerful tool designed to empower your projects with the ability to handle a large number of simultaneous users and external sources.
tiktokenizer
Online playground for OpenAPI tokenizers
gpt4-tokenizer-visualizer
GPT4 Tokenizer Visualizer
chatgpt
Analysis of OpenAI's ChatGPT
Tiktoken
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
free-chat
An elegant LLM chat UI forked from chatgpt-demo of @anse-app. Index site at https://free-chat.asia
1filellm
Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion
openai-function-tokens
Predict the exact openai token usage of functions
openshield
OpenShield is a new generation security layer for AI models