worker-vllm icon indicating copy to clipboard operation
worker-vllm copied to clipboard

Best way to record data

Open aodhan-domhnaill opened this issue 10 months ago • 0 comments

I am looking to record input and output to the vLLM. I could put an HTTP proxy in front and capture the traffic, or modify your handler.

Rather than make changes to the code, I was wondering if you might have a better way to do this?

aodhan-domhnaill avatar Apr 12 '24 18:04 aodhan-domhnaill