add cli webserver handler to get network capabilities
What does this pull request do? Explain your changes. (required) Adds cli webserver endpoint to provide AI models on network in JSON.
This is a very early look at the endpoint to get feedback.
Specific updates (required)
How did you test each of these updates (required)
Does this pull request close any open issues?
Checklist:
- [ ] Read the contribution guide
- [ ]
makeruns successfully - [ ] All tests in
./test.shpass - [ ] README and other documentation updated
- [ ] Pending changelog updated
Last commit reformats the json to return a warm and cold count for each capability/model returned by the orchestrators on discovery requests.
example of json:
{"Image to image":{"ByteDance/SDXL-Lightning":{"Cold":5,"Warm":0},"SG161222/RealVisXL_V4.0":{"Cold":1,"Warm":0},"SG161222/RealVisXL_V4.0_Lightning":{"Cold":2,"Warm":0}},"Image to video":{"stabilityai/stable-video-diffusion-img2vid-xt-1-1":{"Cold":4,"Warm":3}},"Text to image":{"ByteDance/SDXL-Lightning":{"Cold":3,"Warm":4},"ByteDance/SDXL-Lightning-4step":{"Cold":0,"Warm":1},"ByteDance/SDXL-Lightning-8step":{"Cold":0,"Warm":1},"Lykon/dreamshaper-xl-lightning":{"Cold":0,"Warm":1},"SG161222/RealVisXL_V4.0":{"Cold":1,"Warm":1},"SG161222/RealVisXL_V4.0_Lightning":{"Cold":1,"Warm":4}}}
Rebased to current ai-video branch to update capabilities.
@ad-astra-video was this replaced by https://github.com/livepeer/go-livepeer/pull/3246?
Yes this can stay closed
On Wed, Nov 13, 2024 at 3:48 PM Rick Staa @.***> wrote:
@ad-astra-video https://github.com/ad-astra-video was this replaced by #3246 https://github.com/livepeer/go-livepeer/pull/3246?
— Reply to this email directly, view it on GitHub https://github.com/livepeer/go-livepeer/pull/3052#issuecomment-2474888452, or unsubscribe https://github.com/notifications/unsubscribe-auth/AX2BLAFUINPQX6EXNU2OD2T2APCMXAVCNFSM6AAAAABHWDTFV2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZUHA4DQNBVGI . You are receiving this because you were mentioned.Message ID: @.***>
Yes this can stay closed … On Wed, Nov 13, 2024 at 3:48 PM Rick Staa @.> wrote: @ad-astra-video https://github.com/ad-astra-video was this replaced by #3246 <#3246>? — Reply to this email directly, view it on GitHub <#3052 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AX2BLAFUINPQX6EXNU2OD2T2APCMXAVCNFSM6AAAAABHWDTFV2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZUHA4DQNBVGI . You are receiving this because you were mentioned.Message ID: @.>
Thanks! Closed.