openai-cookbook icon indicating copy to clipboard operation
openai-cookbook copied to clipboard

Published 20 hours ago • verified publisher icon openai

add tiktoken_ruby as a tokenizer lib in Ruby

Open qoosuperman opened this issue 1 year ago • 0 comments
trafficstars

Summary

add tiktoken_ruby as a tokenizer library in Ruby

Motivation

See summary

qoosuperman avatar Oct 13 '24 07:10 qoosuperman