MineContext
MineContext copied to clipboard
[FEATURE]: 希望后台调试页面系统监控页面,能提供平均每次访问VLM的耗时统计
📝 Feature Description [Please make everyone to understand it]
http://localhost:8000/monitoring 页面,现在看上下文列表有明显延迟,希望定位是否是VLM回复过慢导致
👍 What problem does this feature solve
No response
👾 What does the proposed API look like
No response
🚑 Any additional information
No response
好的,目前看flash类的模型大概是1min,非flash的话可能会到3min