cl100kbase topic

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.

dmitry-brazhenko

Analysis of OpenAI's ChatGPT

saschaschramm

This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.

tryAGI