djl
djl copied to clipboard
DJL serving management portal
trafficstars
Description
DJL serving should provide a web base management portal to manage models
[ ] Manage models
- register a model
- un-register a model
- update model scaling configurations
- Upgrade a model to new version
- Change model serving system settings
- Support basic admin user authentication and management feature
[ ] DJL serving monitoring system
- Display DJL serving system stat
- Display DJL each model stat
- Config alarms
- DJL serving dashboard
[ ] Manage plugins
- deploy a new plugin
- uninstall a plugin