llm-locust
llm-locust copied to clipboard
LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking
LLM Locust
Running Locust WebUI and Backend Seperatly
WebUI
cd webui && yarn && yarn run dev
Backend
python api.py
Build Locust WebUI and serve via backend
cd webui && yarn && yarn run build
cd .. && python api.py
How it works
