Bradley Heilbrun

icon company Replit icon location Bay Area, California icon location AI @ Replit; Previously, early YouTube/Google/PayPal

Results 1 issues of Bradley Heilbrun

Streaming responses and latency

1 comment

What's the best way to measure duration for streaming endpoints? If I'm not mistaken, the current latency measurements don't work for streaming responses. prometheus_flask_exporter measures the time to return the...