tokenizer topic

Program classic system's 8-bit Basic on a modern environment with modern tools and paradigms (MSX and CoCo modules included).

farique1

Predict the exact openai token usage of functions

rubenselander

OpenShield is a new generation security layer for AI models

openshieldai

Taiwanese Hokkien Transliterator and Tokeniser

andreihar

A fast RWKV Tokenizer written in Rust

cahya-wirawan

Open Source Generative AI Models for Automatic Rhythm Game Beatmap Generation (for acoustic people)

sedthh

Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model

zhenye234

Generated C# SDK based on official HuggingFace OpenAPI specification

tryAGI

llm_utils: Basic LLM tools, best practices, and minimal abstraction.

ShelbyJenkins

Kotlin multiplatform BPE tokenizer library for OpenAI models

aallam