stable-ui
stable-ui copied to clipboard
In dashboard, Scribes should report tokens per second, not MPS
Scribes are LLM text generators. They do not have MPS, resolution. Instead their speed is determined by tokens/second and their max_power is measured in "max_length" and "max_context_length"
Do not want to see this for image workers.