llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

Add a new lifecycle method to providers after the stack has been initialized

Open jeffmaury opened this issue 8 months ago • 2 comments

🚀 Describe the new functionality needed

As I was writing an inference provider that needs to dynamically register models while starting (not through static declaration in run.yaml), I got help from @bbrowning to inject models API but the registration fails because it has to be done in the provider constructor and thus the provider is not yet registered.

💡 Why is this needed? What if we don't build it?

To support dynamic registration of various resources related to the current provider

Other thoughts

Add a new optional lifecycle method in the provider that get called when the stack if fully initiallized

jeffmaury avatar Mar 21 '25 15:03 jeffmaury

This issue has been automatically marked as stale because it has not had activity within 60 days. It will be automatically closed if no further activity occurs within 30 days.

github-actions[bot] avatar May 21 '25 00:05 github-actions[bot]

Still accurate

jeffmaury avatar May 21 '25 07:05 jeffmaury

This issue has been automatically marked as stale because it has not had activity within 60 days. It will be automatically closed if no further activity occurs within 30 days.

github-actions[bot] avatar Jul 21 '25 00:07 github-actions[bot]

@jeffmaury which inference provider?

mattf avatar Jul 21 '25 09:07 mattf

Podman AI Lab

jeffmaury avatar Jul 21 '25 10:07 jeffmaury

@jeffmaury where can i find the code? is the issue that users cannot register models not in the static list? is the issue that users should not need to register models at all?

mattf avatar Jul 21 '25 12:07 mattf

This issue has been automatically marked as stale because it has not had activity within 60 days. It will be automatically closed if no further activity occurs within 30 days.

github-actions[bot] avatar Sep 20 '25 00:09 github-actions[bot]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant!

github-actions[bot] avatar Oct 20 '25 00:10 github-actions[bot]