tokmon

tokmon copied to clipboard

Requests made in jupyter notebooks are not beamed

2

Steps to reproduce: 1. `OPENAI_API_KEY="..." tokmon --no_json --beam localhost:9000 jupyter-notebook` 2. Create a new notebook 3. Paste the contents of https://github.com/yagil/tokmon/blob/main/tests/python_example.py into a cell 4. Run the cell Expected results:...

motin

New models and pricing not reflected in the pricing json

1

A placeholder issue to remember to update the pricing json (Yesterday, new models and adjusted pricing came out: https://openai.com/blog/function-calling-and-other-api-updates) (Really neat and simple app @yagil!)

motin

If the monitored program makes use of OpenAI response streaming (with SSE), incoming chunks gets buffered until the `[DONE]` message. This alters the behavior of the monitored program and is...

yagil