Siyuan (Ryans) Zhuang

We add an experimental OpenAI compatible API - https://github.com/lm-sys/FastChat#openai-compatible-restful-apis--sdk. Would this be helpful?

Also do you mean designing some 'tricky' questions (or just general benchmarks with some known public datasets)? For example, there are some known tricks (e.g., "hypnosis") that works effectively on...

I think this is a gradio issue. Let me investigate.

It should have been fixed by #3356

Here is the doc for pickle5: https://www.python.org/dev/peps/pep-0574/ I think to fully support pickle5, we need some C++/Cython code to expose the underlying buffer of python objects. I am not sure...

Yep, it is pretty good to have a native code extension. I also notice that ion-python uses bytearray, maybe it is useful for faster serialization. Let me dig a bit...