jan
jan copied to clipboard
feat: Add NVIDIA GPU monitoring on windows/ linux
Problem I want to see my nvidia gpu monitoring (GPU utilization/ VRAM) on Jan to check the resource consumption of models use
Success Criteria
- Correctly show the utilization
- Can see the UI at bottom bar
Additional context
- https://github.com/RedCarrottt/nvmon/blob/master/nvmon-smi-server.js
Looking forward to this!
Design ticket is complete: #1646 cc @hiro-v
Following up in https://github.com/janhq/jan/pull/1730